{"product_id":"learning-from-data-isbn-9780471681823","title":"Learning from Data","description":"An interdisciplinary framework for learning methodologies—covering statistics, neural networks, and fuzzy logic, this book provides a unified treatment of the principles and methods for learning dependencies from data. It establishes a general conceptual framework in which various learning methods from statistics, neural networks, and fuzzy logic can be applied—showing that a few fundamental principles underlie most new methods being proposed today in statistics, engineering, and computer science. Complete with over one hundred illustrations, case studies, and examples making this an invaluable text.  PREFACE.  \u003cp\u003eNOTATION.\u003c\/p\u003e \u003cp\u003e\u003cb\u003e1 Introduction.\u003c\/b\u003e\u003c\/p\u003e \u003cp\u003e1.1 Learning and Statistical Estimation.\u003c\/p\u003e \u003cp\u003e1.2 Statistical Dependency and Causality.\u003c\/p\u003e \u003cp\u003e1.3 Characterization of Variables.\u003c\/p\u003e \u003cp\u003e1.4 Characterization of Uncertainty.\u003c\/p\u003e \u003cp\u003e1.5 Predictive Learning versus Other Data Analytical Methodologies.\u003c\/p\u003e \u003cp\u003e\u003cb\u003e2 Problem Statement, Classical Approaches, and Adaptive Learning.\u003c\/b\u003e\u003c\/p\u003e \u003cp\u003e2.1 Formulation of the Learning Problem.\u003c\/p\u003e \u003cp\u003e2.1.1 Objective of Learning.\u003c\/p\u003e \u003cp\u003e2.1.2 Common Learning Tasks.\u003c\/p\u003e \u003cp\u003e2.1.3 Scope of the Learning Problem Formulation.\u003c\/p\u003e \u003cp\u003e2.2 Classical Approaches.\u003c\/p\u003e \u003cp\u003e2.2.1 Density Estimation.\u003c\/p\u003e \u003cp\u003e2.2.2 Classification.\u003c\/p\u003e \u003cp\u003e2.2.3 Regression.\u003c\/p\u003e \u003cp\u003e2.2.4 Solving Problems with Finite Data.\u003c\/p\u003e \u003cp\u003e2.2.5 Nonparametric Methods.\u003c\/p\u003e \u003cp\u003e2.2.6 Stochastic Approximation.\u003c\/p\u003e \u003cp\u003e2.3 Adaptive Learning: Concepts and Inductive Principles.\u003c\/p\u003e \u003cp\u003e2.3.1 Philosophy, Major Concepts, and Issues.\u003c\/p\u003e \u003cp\u003e2.3.2 A Priori Knowledge and Model Complexity.\u003c\/p\u003e \u003cp\u003e2.3.3 Inductive Principles.\u003c\/p\u003e \u003cp\u003e2.3.4 Alternative Learning Formulations.\u003c\/p\u003e \u003cp\u003e2.4 Summary.\u003c\/p\u003e \u003cp\u003e\u003cb\u003e3 Regularization Framework.\u003c\/b\u003e\u003c\/p\u003e \u003cp\u003e3.1 Curse and Complexity of Dimensionality.\u003c\/p\u003e \u003cp\u003e3.2 Function Approximation and Characterization of Complexity.\u003c\/p\u003e \u003cp\u003e3.3 Penalization.\u003c\/p\u003e \u003cp\u003e3.3.1 Parametric Penalties.\u003c\/p\u003e \u003cp\u003e3.3.2 Nonparametric Penalties.\u003c\/p\u003e \u003cp\u003e3.4 Model Selection (Complexity Control).\u003c\/p\u003e \u003cp\u003e3.4.1 Analytical Model Selection Criteria.\u003c\/p\u003e \u003cp\u003e3.4.2 Model Selection via Resampling.\u003c\/p\u003e \u003cp\u003e3.4.3 Bias–Variance Tradeoff.\u003c\/p\u003e \u003cp\u003e3.4.4 Example of Model Selection.\u003c\/p\u003e \u003cp\u003e3.4.5 Function Approximation versus Predictive Learning.\u003c\/p\u003e \u003cp\u003e3.5 Summary.\u003c\/p\u003e \u003cp\u003e\u003cb\u003e4 Statistical Learning Theory.\u003c\/b\u003e\u003c\/p\u003e \u003cp\u003e4.1 Conditions for Consistency and Convergence of ERM.\u003c\/p\u003e \u003cp\u003e4.2 Growth Function and VC Dimension.\u003c\/p\u003e \u003cp\u003e4.2.1 VC Dimension for Classification and Regression Problems.\u003c\/p\u003e \u003cp\u003e4.2.2 Examples of Calculating VC Dimension.\u003c\/p\u003e \u003cp\u003e4.3 Bounds on the Generalization.\u003c\/p\u003e \u003cp\u003e4.3.1 Classification.\u003c\/p\u003e \u003cp\u003e4.3.2 Regression.\u003c\/p\u003e \u003cp\u003e4.3.3 Generalization Bounds and Sampling Theorem.\u003c\/p\u003e \u003cp\u003e4.4 Structural Risk Minimization.\u003c\/p\u003e \u003cp\u003e4.4.1 Dictionary Representation.\u003c\/p\u003e \u003cp\u003e4.4.2 Feature Selection.\u003c\/p\u003e \u003cp\u003e4.4.3 Penalization Formulation.\u003c\/p\u003e \u003cp\u003e4.4.4 Input Preprocessing.\u003c\/p\u003e \u003cp\u003e4.4.5 Initial Conditions for Training Algorithm.\u003c\/p\u003e \u003cp\u003e4.5 Comparisons of Model Selection for Regression.\u003c\/p\u003e \u003cp\u003e4.5.1 Model Selection for Linear Estimators.\u003c\/p\u003e \u003cp\u003e4.5.2 Model Selection for k-Nearest-Neighbor Regression.\u003c\/p\u003e \u003cp\u003e4.5.3 Model Selection for Linear Subset Regression.\u003c\/p\u003e \u003cp\u003e4.5.4 Discussion.\u003c\/p\u003e \u003cp\u003e4.6 Measuring the VC Dimension.\u003c\/p\u003e \u003cp\u003e4.7 VC Dimension, Occam’s Razor, and Popper’s Falsifiability.\u003c\/p\u003e \u003cp\u003e4.8 Summary and Discussion.\u003c\/p\u003e \u003cp\u003e\u003cb\u003e5 Nonlinear Optimization Strategies.\u003c\/b\u003e\u003c\/p\u003e \u003cp\u003e5.1 Stochastic Approximation Methods.\u003c\/p\u003e \u003cp\u003e5.1.1 Linear Parameter Estimation.\u003c\/p\u003e \u003cp\u003e5.1.2 Backpropagation Training of MLP Networks.\u003c\/p\u003e \u003cp\u003e5.2 Iterative Methods.\u003c\/p\u003e \u003cp\u003e5.2.1 EM Methods for Density Estimation.\u003c\/p\u003e \u003cp\u003e5.2.2 Generalized Inverse Training of MLP Networks.\u003c\/p\u003e \u003cp\u003e5.3 Greedy Optimization.\u003c\/p\u003e \u003cp\u003e5.3.1 Neural Network Construction Algorithms.\u003c\/p\u003e \u003cp\u003e5.3.2 Classification and Regression Trees.\u003c\/p\u003e \u003cp\u003e5.4 Feature Selection, Optimization, and Statistical Learning Theory.\u003c\/p\u003e \u003cp\u003e5.5 Summary.\u003c\/p\u003e \u003cp\u003e\u003cb\u003e6 Methods for Data Reduction and Dimensionality Reduction.\u003c\/b\u003e\u003c\/p\u003e \u003cp\u003e6.1 Vector Quantization and Clustering.\u003c\/p\u003e \u003cp\u003e6.1.1 Optimal Source Coding in Vector Quantization.\u003c\/p\u003e \u003cp\u003e6.1.2 Generalized Lloyd Algorithm.\u003c\/p\u003e \u003cp\u003e6.1.3 Clustering.\u003c\/p\u003e \u003cp\u003e6.1.4 EM Algorithm for VQ and Clustering.\u003c\/p\u003e \u003cp\u003e6.1.5 Fuzzy Clustering.\u003c\/p\u003e \u003cp\u003e6.2 Dimensionality Reduction: Statistical Methods.\u003c\/p\u003e \u003cp\u003e6.2.1 Linear Principal Components.\u003c\/p\u003e \u003cp\u003e6.2.2 Principal Curves and Surfaces.\u003c\/p\u003e \u003cp\u003e6.2.3 Multidimensional Scaling.\u003c\/p\u003e \u003cp\u003e6.3 Dimensionality Reduction: Neural Network Methods.\u003c\/p\u003e \u003cp\u003e6.3.1 Discrete Principal Curves and Self-Organizing Map Algorithm.\u003c\/p\u003e \u003cp\u003e6.3.2 Statistical Interpretation of the SOM Method.\u003c\/p\u003e \u003cp\u003e6.3.3 Flow-Through Version of the SOM and Learning Rate Schedules.\u003c\/p\u003e \u003cp\u003e6.3.4 SOM Applications and Modifications.\u003c\/p\u003e \u003cp\u003e6.3.5 Self-Supervised MLP.\u003c\/p\u003e \u003cp\u003e6.4 Methods for Multivariate Data Analysis.\u003c\/p\u003e \u003cp\u003e6.4.1 Factor Analysis.\u003c\/p\u003e \u003cp\u003e6.4.2 Independent Component Analysis.\u003c\/p\u003e \u003cp\u003e6.5 Summary.\u003c\/p\u003e \u003cp\u003e\u003cb\u003e7 Methods for Regression.\u003c\/b\u003e\u003c\/p\u003e \u003cp\u003e7.1 Taxonomy: Dictionary versus Kernel Representation.\u003c\/p\u003e \u003cp\u003e7.2 Linear Estimators.\u003c\/p\u003e \u003cp\u003e7.2.1 Estimation of Linear Models and Equivalence of Representations.\u003c\/p\u003e \u003cp\u003e7.2.2 Analytic Form of Cross-Validation.\u003c\/p\u003e \u003cp\u003e7.2.3 Estimating Complexity of Penalized Linear Models.\u003c\/p\u003e \u003cp\u003e7.2.4 Nonadaptive Methods.\u003c\/p\u003e \u003cp\u003e7.3 Adaptive Dictionary Methods.\u003c\/p\u003e \u003cp\u003e7.3.1 Additive Methods and Projection Pursuit Regression.\u003c\/p\u003e \u003cp\u003e7.3.2 Multilayer Perceptrons and Backpropagation.\u003c\/p\u003e \u003cp\u003e7.3.3 Multivariate Adaptive Regression Splines.\u003c\/p\u003e \u003cp\u003e7.3.4 Orthogonal Basis Functions and Wavelet Signal Denoising.\u003c\/p\u003e \u003cp\u003e7.4 Adaptive Kernel Methods and Local Risk Minimization.\u003c\/p\u003e \u003cp\u003e7.4.1 Generalized Memory-Based Learning.\u003c\/p\u003e \u003cp\u003e7.4.2 Constrained Topological Mapping.\u003c\/p\u003e \u003cp\u003e7.5 Empirical Studies.\u003c\/p\u003e \u003cp\u003e7.5.1 Predicting Net Asset Value (NAV) of Mutual Funds.\u003c\/p\u003e \u003cp\u003e7.5.2 Comparison of Adaptive Methods for Regression.\u003c\/p\u003e \u003cp\u003e7.6 Combining Predictive Models.\u003c\/p\u003e \u003cp\u003e7.7 Summary.\u003c\/p\u003e \u003cp\u003e\u003cb\u003e8 Classification.\u003c\/b\u003e\u003c\/p\u003e \u003cp\u003e8.1 Statistical Learning Theory Formulation.\u003c\/p\u003e \u003cp\u003e8.2 Classical Formulation.\u003c\/p\u003e \u003cp\u003e8.2.1 Statistical Decision Theory.\u003c\/p\u003e \u003cp\u003e8.2.2 Fisher’s Linear Discriminant Analysis.\u003c\/p\u003e \u003cp\u003e8.3 Methods for Classification.\u003c\/p\u003e \u003cp\u003e8.3.1 Regression-Based Methods.\u003c\/p\u003e \u003cp\u003e8.3.2 Tree-Based Methods.\u003c\/p\u003e \u003cp\u003e8.3.3 Nearest-Neighbor and Prototype Methods.\u003c\/p\u003e \u003cp\u003e8.3.4 Empirical Comparisons.\u003c\/p\u003e \u003cp\u003e8.4 Combining Methods and Boosting.\u003c\/p\u003e \u003cp\u003e8.4.1 Boosting as an Additive Model.\u003c\/p\u003e \u003cp\u003e8.4.2 Boosting for Regression Problems.\u003c\/p\u003e \u003cp\u003e8.5 Summary.\u003c\/p\u003e \u003cp\u003e\u003cb\u003e9 Support Vector Machines.\u003c\/b\u003e\u003c\/p\u003e \u003cp\u003e9.1 Motivation for Margin-Based Loss.\u003c\/p\u003e \u003cp\u003e9.2 Margin-Based Loss, Robustness, and Complexity Control.\u003c\/p\u003e \u003cp\u003e9.3 Optimal Separating Hyperplane.\u003c\/p\u003e \u003cp\u003e9.4 High-Dimensional Mapping and Inner Product Kernels.\u003c\/p\u003e \u003cp\u003e9.5 Support Vector Machine for Classification.\u003c\/p\u003e \u003cp\u003e9.6 Support Vector Implementations.\u003c\/p\u003e \u003cp\u003e9.7 Support Vector Regression.\u003c\/p\u003e \u003cp\u003e9.8 SVM Model Selection.\u003c\/p\u003e \u003cp\u003e9.9 Support Vector Machines and Regularization.\u003c\/p\u003e \u003cp\u003e9.10 Single-Class SVM and Novelty Detection.\u003c\/p\u003e \u003cp\u003e9.11 Summary and Discussion.\u003c\/p\u003e \u003cp\u003e\u003cb\u003e10 Noninductive Inference and Alternative Learning Formulations.\u003c\/b\u003e\u003c\/p\u003e \u003cp\u003e10.1 Sparse High-Dimensional Data.\u003c\/p\u003e \u003cp\u003e10.2 Transduction.\u003c\/p\u003e \u003cp\u003e10.3 Inference Through Contradictions.\u003c\/p\u003e \u003cp\u003e10.4 Multiple-Model Estimation.\u003c\/p\u003e \u003cp\u003e10.5 Summary.\u003c\/p\u003e \u003cp\u003e11 Concluding Remarks.\u003c\/p\u003e \u003cp\u003eAppendix A: Review of Nonlinear Optimization.\u003c\/p\u003e \u003cp\u003eAppendix B: Eigenvalues and Singular Value Decomposition.\u003c\/p\u003e \u003cp\u003eReferences.\u003c\/p\u003e \u003cp\u003eIndex.\u003c\/p\u003e \u003cp\u003e \u003c\/p\u003e  \"I think \u003ci\u003eLearning From Data\u003c\/i\u003e is a very valuable volume. I will recommend it to my graduate students.\" (\u003ci\u003eJournal of the American Statistical Association\u003c\/i\u003e, March 2009)  \u003cp\u003e\"The broad spectrum of information it offers is beneficial to many field of research. The selection of topics is good, and I believe that many researchers and practioners will find this book useful.\" (\u003ci\u003eTechnometrics\u003c\/i\u003e, May 2008)\u003c\/p\u003e \u003cp\u003e\"The authors have succeeded in summarizing some of the recent trends and future challenges in different learning methods, including enabling technologies and some interesting practical applications.\" (\u003ci\u003eComputing Reviews,\u003c\/i\u003e May 22, 2008)\u003c\/p\u003e  \u003cp\u003eVladimir CherKassky, PhD, is Professor of Electrical and Computer Engineering at the University of Minnesota. He is internationally known for his research on neural networks and statistical learning.\u003c\/p\u003e \u003cp\u003eFilip Mulier, PhD, has worked in the software field for the last twelve years, part of which has been spent researching, developing, and applying advanced statistical and machine learning methods. He currently holds a project management position.\u003c\/p\u003e  \u003cp\u003eAn interdisciplinary framework for learning methodologies—now revised and updated\u003c\/p\u003e \u003cp\u003eLearning from Data provides a unified treatment of the principles and methods for learning dependencies from data. It establishes a general conceptual framework in which various learning methods from statistics, neural networks, and pattern recognition can be applied—showing that a few fundamental principles underlie most new methods being proposed today in statistics, engineering, and computer science.\u003c\/p\u003e \u003cp\u003eSince the first edition was published, the field of data-driven learning has experienced rapid growth. This Second Edition covers these developments with a completely revised chapter on support vector machines, a new chapter on noninductive inference and alternative learning formulations, and an in-depth discussion of the VC theoretical approach as it relates to other paradigms.\u003c\/p\u003e \u003cp\u003eComplete with over one hundred illustrations, case studies, examples, and chapter summaries, Learning from Data accommodates both beginning and advanced graduate students in engineering, computer science, and statistics. It is also indispensable for researchers and practitioners in these areas who must understand the principles and methods for learning dependencies from data.\u003c\/p\u003e","brand":"Wiley-IEEE Press","offers":[{"title":"Default Title","offer_id":47989521350885,"sku":"NP9780471681823","price":181.95,"currency_code":"USD","in_stock":false}],"thumbnail_url":"\/\/cdn.shopify.com\/s\/files\/1\/1842\/7735\/files\/9780471681823.jpg?v=1761784441","url":"https:\/\/k12savings.com\/products\/learning-from-data-isbn-9780471681823","provider":"K12savings","version":"1.0","type":"link"}