Machine Learning Resources

Suggestions welcome

Applications (related to ML)

• Browsers/Assistants (i.e., WWW-Learning)
• InfoFinder (Andersen Consulting)
• The Informant (Dartmouth)
• Java Meta-Learning (Sal Stolfo)
• Syskill & Webert (UC Irvine)
• WebWatcher (CMU)
• Firefly
• My Yahoo!
• List of Published ML Applications (outdated) (David W. Aha) 
• Workshops
• Report on the MLnet Workshop on Industrial Applications of Machine Learning (ILWS'94; Yves Kodratoff)
• ICML-95 Workshop: Applying ML in Practice
• ICML-97 Workshop (Engles, Verdenius, Evans & Herrman)
• ICML-98 Workshop on The Methodology of Applying Machine Learning: Problem Definition, Task Decomposition and Technique Selection
• Workshop Summary

Bibliographies (surely this is incomplete!)

• Baldwin effect (Turney, Whitley, & Anderson)
• Bayesian tree classification methods (Wray Buntine)
• Bias Shift (Peter Turney)
• Computer Science Bibliographies
• Computational Learning Theory
• Conceptual Clustering (Luis Talavera)
• Context-Sensitive Learning (Peter Turney)
• Cost-Sensitive Learning (Peter Turney)
• Feature Selection (Peter Turney)
• KDD and Data Mining (Andy Pryke)
• Lazy Learning: A Living Annotated Bibliography (David W. Aha)
• Machine Learning (Peter Turney)
• Machine Learning Applied to Information Retrieval (Peter Turney)
• Machine Learning in Strategic Game Playing (Johannes Fürnkranz)
• A Machine Learning Bibliography (University of Dortmund)
• Bibliography of Machine Learning (University of Manitoba)
• Lists of references
• Combining Estimators (Tirthanker Ray Chadhuri)
• Context-Sensitive Learning (Peter Turney)
• Cost-Sensitive Learning (Peter Turney)
• Decision Trees
• Feature Selection
• Lazy Learning
• Feature weighting (i.e., for similarity functions)
• Fast implementations
• Formal Analyses
• Function Learning
• Instance-averaging
• Integration: Genetic algorithms
• Integration: Rules
• Learning prototypes
• Storage reduction
• Neural Networks
• Data Exploration Using Self-Organizing Maps (Dissertation, Sami Kaski)
• Rule extraction from artificial neural nets (Andrews, Diederich, & Giles)
• Symbolic Neural Networks (Olcay Boz)

Books

Commercial

• Abtech Corporation (ModelQuest statistical/neural network tool)
• ALTA Analytics (NETMAP)
• Knowledge Technologies of Andersen Consulting (Data Mining Consulting Services)
• Angoss International Limited (KnowledgeSEEKER, KnowledgeSTUDIO)
• Attar Software (XpertRule Profiler)
• Belmont Research: CrossGraphs
• Blue Martini Software
• J.P. Brown Ultimate Resources, Inc. (SuperInduction)
• Cirrus Recognition (CirrusNet neural network technology)
• Data Distilleries
• DAZ Systems Incorporated (Data-Mining and KDD Products)
• DBMiner Technology Inc. (DBMiner)
• Integral Decisions Systems SE GmbH (Datamining vendors & consultants)
• Information Discovery, Inc. (Information Discovery System, Customer Retail News, Intra-Knowledge, etc)
• InfoWare (makers of STATlab)
• Integral Solutions, Ltd. (Clementine)
• IBM
• Quest (Data Mining Project)
• Advanced Scout (Data Miner; see the NBA application)
• Intelligent Application (Edinburgh, Scotland)
• ISoft
• Makers of ALICE
• Jurik Research Software (provides data preprocessing software for neural nets)
• Knowledge Industries
• Megaputer Intelligence, Ltd. (PolyAnalyst)
• Management Intelligenter Technologien GmbH
• NeoVista Solutions, Inc.
• Neural Technologies
• Prediction Company
• Q-Why
• Reduct & Lobbe, Inc (makers of DataLogic)
• Renascence Partners
• Easynet Neural Net software package
• RuleQuest Research (Makers of Cubist; J. Ross Quinlan, CEO)
• Salford Systems (makers of CART software)
• Silicon Graphics
• MineSet
• Semio Corporation (Makers of SemioMap)
• Smart Information Services GmbH (intelligent information retrieval services)
• Tandem Computers Inc. (makers of an object relational data mining architecture)
• TRIADA (Ngram technology)
• Ultragem (Using GA's)
• WizSoft, Inc. (WizRule)
• ZDM Scientific Ltd.

Conference Announcements

Courses on Machine Learning

Data Repositories

• CMU Artificial Intelligence Repository
• Machine Learning
• GMD Repository
• National Space Science Data Center (e.g., NASA's datasets)
• ILP Applications and Datasets (Oxford University)
• RISE: ISI Repository of Test Domains for Learning Extraction Rules
• Datasets at Silicon Graphics
• Census Income
• Census Year
• StatLib
• StatLog
• Synthetic Classification Data Sets Program (SCDS, Gabor Melli)
• UCI Repository
• Reference as: Blake, C., Keogh, E. & Merz, C.J. (1998). UCI Repository of machine learning databases [www.ics.uci.edu/~mlearn/MLRepository.html]. Irvine, CA: University of California, Department of Information and Computer Science.
• Unipen
• AI Planning Domain Repository (University of Maryland)
• University of Nevada at Reno

Home Pages

• ML/CBR Home Pages (David W. Aha)
• Bayesian Statisticians Home Pages
• Data Miners (Andy Pryke)
• Programming by Example (Henry Lieberman)
• SIGNLL Members (Antal van den Bosch)

Information

Applications | Artificial Life | Belief Nets | Competitions | COLT | Design | Evaluation | Fuzzy Logic | Games | General ML Resources Pages | Genetic Algorithms | Human-Computer Learning | Inductive Logic Programming | Information Retrieval | Knowledge Acquisition | KDD | Knowledge Engineering | Lazy Learning | Link Analysis | Local Learning | Manufacturing | Mixture Models | Multi-Agent Learning | Neural Networks | Ontologies | Planning | Robots | Rough Sets | Skill Acquisition | Temporal Processing
• Applications
• Applications in Machine Learning (Asa Rudstrom)
• Artificial Life
• Report on the ALife V Conference
• SIM_AGENT Toolkit (U. Birmingham)
• Belief Nets
• Bayesian Knowledge Discovery Project (The Open University)
• Competitions
• Abbadingo One: DFA Learning Competition (Lang and Pearlmutter)
• Results of the New East-West Challenge (Michie, Muggleton, Page, & Srinivasan)
• Computational Learning Theory
• Computational Learning Theory (Nicolo Cesa-Bianchi)
• COLT Bibliography (U. Maryland)
• Design
• ML in Engineering Design and Manufacturing (Yoram Reich)
• 1996 AI & Design Conference Workshop on ML in Design (Brown, Goel, and Duffy)
• Evaluation
• Evaluation of Intelligent Systems (An on-line resource)
• Fuzzy Logic
• Links (Bjarne Hansen)
• Games
• Bibliography on ML in Strategic Game Playing (Johannes Fuernkranz)
• Machine Learning in Games (Jay Scott)
• First Tournament of Learning to Play Games
• General ML Resources Pages
• Miningco.com's AI Site
• AI Subject Index on ML (CNRC)
• AI/ML Resources (Andy Pryke)
• IFIP/SWI Machine Learning Pages
• Information Services (Austrian Research Institute for AI)
• Intelligent Software Products (SAIC G6G)
• Laksberg's Machine Learning Archive (Artur Laksberg)
• Machine Learning Resources (Paul Nielsen)
• MLnet Machine Learning Archive (GMD)
• Other WWW Pages of Interest (Chuck Anderson)
• Digital Library at U. Macedonia
• Science: CS: AI: ML (Yahoo)
• Genetic Algorithms
• Genetic Algorithms Archive (NRL)
• Genetic Programming (Jaime Fernandez)
• Nova Genetica
• Human-Computer Learning
• Human-Computer Learning Foundation
• Inductive Logic Programming
• ILPnet2
• Introduction to ILP (Oxford University)
• ILP for KDD Workshop at ICML-96
• Top-Down Induction of First Order Logical Decision Trees (PhD dissertation, Hendrik Blockeel)
• Information Retrieval
• Bibliography on Applying ML to IR Tasks (Peter Turney, previously Rik Belew and Jude Shavlik)
• Knowledge Acquisition
• Brian Gaine's KAW Page
• Knowledge Discovery in Databases (e.g., Data Mining)
• Comparisons
• Comparison of DM Tools (Ovum)
• Elder Research Website (Contains notes on KDD-98 copmarisons)
• KDD-Cup-98: 2nd International Data Mining Tools Competition (Parsa and Howes)
• Corporate KDD Bookmark (Thierry Van de Merckt)
• Cross-Industry Standard Process Model for Data Mining
• Databases & Logic Programming (Michael Ley)
• The Data Mine (Andy Pryke)
• Debunking Data Mining Myths (Robert D. Small, InformationWeek article)
• Knowledge Discovery Mine (Gregory-Piatetsky Shapiro)
• Predictive Toxicology Evaluation Challenge (Srinivasan & King)
• Terminology, Data Mining (Willie Kloesgen & Jan Zytkow)
• Vanderbilt University
• VLDB Home Page
• Knowledge Engineering
• Knowledge Engineering Methods and Languages
• Lazy Learning
• Prototype Selection for Composite Nearest Neighbor Classifiers (David Skalak, PhD dissertation)
• Lazy Learning Special Issue in AI Review (Ed.: D.W. Aha)
• Link Analysis
• 1998 AAAI Fall Symposium on AI & Link Analysis
• Local Learning
• Georgia Tech (Chris Atkeson)
• Manufacturing
• The AUTON Project (Andrew Moore and colleagues)
• Mixture Models
• TR: Additive Logistic Regression: a Statistical View of Boosting (8/98: Friedman, Hastie, & Tibshirani)
• Mixture Models (David Dowe)
• Classification and Regression using Mixtures of Experts (Steve Waterhouse, PhD dissertation)
• Classification and Regression by Combining Models (dissertation by Chris Merz)
• Bibtex file of Chris's references
• Multi-Agent Learning
• Learning in Multi-Agent Systems Webliography
• Adaptation and Learning in Multi-Agent Systems (book; Weiss & Sen, Eds.)
• Neural Networks
• Announcements of Conferences, Workshops, and Other Events on Neural Networks, Vision, and Speech
• NN Benchmarking (Lutz Prechelt)
• Searle's terrific summary relating neural nets with other approaches
• Hybrid Connectionist-Symbolic Models: A Report from the IJCAI'95 Workshop (Ron Sun)
• Ontologies
• Onotology Information (Doug Skuce)
• Planning
• Learning Procedural Planning Knowledge in Complex Environments (11/96 dissertation by Doublas J. Pearson, U. Michigan)
• Planning Resources (Rob St. Amant)
• UMCP Hierarchical Task Network Planning Algorithm
• Robots
• Xavier (CMU)
• Rough Sets
• Electronic Bulletin of the Rough Set Community
• Skill Acquisition
• Skill Acquisition Info Page (University of Karlsruhe)
• Temporal Processing
• Dissertation: Refinement of Temporal Constraints in an Event Recognition System using Small Datasets (George Paliouras, U. Manchester, 1997)

Job Listings

Job Seekers

Journals & Special Issues

Mailing Lists

• AI & KBS for Nondestructive Testing
• a href="http://www.listbot.com/subscribe/DESKPACK">Subscription
• AI & Statistics Mailing List
• datamine-l (Data Mining/Knowledge Discovery/Data Warehousing)
• European Mailing List on Learning Robots (Volker Klingspor)
• Hybrid Models - Learning and Architectures (Vasant Honavar): To subscribe.
• Inductive Logic Programming Network
• Knowledge Acquisition (Kaw)
• Knowledge Discovery Mine
• Uncertainty in AI
• ML-List
• Machine Learning for User Modeling

Mirrors

• UK: CCP14 Auto-Mirrored Web Sites

ML Search Engines

• Biblio (Austrian AI Institute; Publications)
• ML Papers (Andrew Ng)
• ML Search (Andrew Ng and Dayne Freitag: WWW Pages)
• Neuroscience (Fred Lenherr)

Publication Search Engines

• Biblio: Search for a publication (Austrian AI Institute)
• Database Bibliographies (Mohan Kamath, U. Massachusetts)
• Unified Computer Science TR Search (Marc VanHeyuningen, U. Indiana)

Research Groups

• Australia
• Australian National University
• CSIRO (Gov't research organization)
• University of New South Wales
• University of Sydney
• Austria
• Austrian Research Institute for AI (OFAI)
• Belgium
• Katholieke Universiteit Leuven
• Canada
• Canadian National Research Council
• University of Ottawa
University of Waterloo
• France
• Université Paris Sud
• Université Pierre et Marie Curie (ACASA)
• Germany
• German National Research Center for Information Technology
• Goethe University
• Laboratory for Data Mining
• University of Kaiserslautern
• Learning Laboratory
• Autonomous Mobile Robots
• University of Karlshrue
• Israel
• The Hebrew University
• Italy
• University of Torino
• New Zealand
• University of Waikato
• Portugal
• University of Porto
• Slovenia
• Jozef Stefan Institute
• Spain
• Spanish Scientific Research Council
• Switzerland
• Dalle Molle Institute for Perceptual AI (IDIAP)
• Turkey
• Bilkent University
• United Kingdom
• Robert Gordon University
• Oxford, University
• Turing Institute
• University of Bristol
• University College London (Gatsby Computational Neuroscience Unit)
• University of the West of England
• Evolutionary Computing Group
• M.S. in Machine Learning and Adaptive Computing
• United States
• Brigham Young University
• Carnegie Mellon University
• AUTON: Autonomous Machine Learning Lab (Andrew Moore and colleagues)
• Learning Laboratory
• Learning Robots Laboratory
• Reinforcement Learning
• Colorado State University
• General Electric Research and Development Center (Information Technology Laboratory)
• George Mason University
• Georgia Institute of Technology
• IBM Almaden Research Center (Data Mining Project)
• Data Mining Home Page
• Institute for the Learning Sciences
• Iowa State University
• JPL AI Group
• Massachusetts Institute of Technology
• Center for Biological and Computational Learning
• Programming by Example
• Naval Research Laboratory
• NEC Research Institute
• Rutgers University
• Soar
• The SOAR Songbook
• United States Air Force Academy
• University of California at Irvine
• University of California at Santa Cruz
• University of Illinoise at Urbana-Champaign
• Inductive Learning
• Explanation-Based Learning
• University of Massachusetts
• Adaptive Networks Lab
• ML Lab
• University of New Mexico (Adaptive Computation Group)
• University of Southern Florida
• University of Texas at Austin
• University of Wisconsin at Madison
• Vanderbilt University

Software (see also Information)

• Bayesian Networks
• BAYDA (Henry Tirri)
• Bayesian Knowledge Discoverer (Marco Ramoni)
• Belief Networks (Russell Almond)
• Belief Network Power Constructor (Jie Cheng)
• USA Mirror Site
• BAYDA (U. Helsinki, Complex Systems Computation Group)
• Microsoft Bayesian Networks Modeling Tool (MSBN; network construction & evaluation)
• Belief Network Power Constructor (Jie Cheng)
• Evaluation of Multiple Systems
• ROC Convex Hull for Comparing Classifiers (Tom Fawcett, Foster Provost)
• Clustering: See Unsupervised Learning
• Collections (Varied) of Programs
• Data Mining Siftware
• MLT Toolbox (GMD)
• UCI ML programs (FOCL, Occam, etc)
• Siftware at the Knowledge Discovery Mine (Gregory Piatetsky-Shapiro)
• ML Research Software (University of Texas at Austin)
• Peter Clark - ML Software
• Prolog Library of ML Programs (Thomas Hoppe, GMD)
• TOOLDIAG (U. Lisbon & UNINOVA)
• Data Generators
• Database Generator (Gabo Melli)
• Data Mining
• SGI's MineSet
• Siftware at the Knowledge Discovery Mine
• Agent-Based Data Mining (Sal Stolfo)
• DBPredictor on-line Classification System (Gabor Melli, Simon Fraser University)
• Decision Trees (TDIDT) and Rule Inducers
• C4.5 and its extensions
• C4.5's FTP Directory (J. Ross Quinlan)
• Parallel C4.5 (Bin Li)
• C5.0 info and demonstration versions
• CN2 (Peter Clark)
• CN2 Integrated with Qualitative Modelling (Peter Clark)
• Incremental Decision Trees(Paul Utgoff)
• OC1 (Johns Hopkins University)
• SIPINA (D.A. Zighed)
• Explanation-Based Learning
• Lazy Partial Evaluation (Peter Clark)
• First-Order Representations (e.g., Inductive Logic Programming)
• ACCEL (University of Texas at Austin; first-order abductive construction of explanations)
• Claudien (Luc Dehaspe, Luc De Raedt, & Wim Van Laer)
• CRUSTACEAN (David W. Aha)
• FDEP (induces functional dependencies from relations) (Iztok Savnik)
• FOIL (J. Ross Quinlan)
• GMD's ILP Software Repository
• FORTE (University of Texas at Austin; first-order theory revision)
• Genetic Algorithms
• Genetic Algorithms source code (NRL's GA Archive)
• REGAL 3.0 (University of Torino)
• Automatic Design of Algorithms Through Evolution (ADATE)
• Swarm (Santa Fe Institute)
• Lazy Learning
• IBL (David W. Aha)
• NGE (David W. Aha)
• PEBLS (Johns Hopkins University)
• Protos (Bruce Porter)
• TiMBL (ILK, Tilburg: a suite of tools)
• TiMBL Reference Guide
• Knowledge Acquisition
• Mobal (GMD)
• Neural Networks
• Bayesian Learning for Neural Networks (Radford Neal)
• Fahlmann's Neural Networks
• A free Neural Network repository (Lutz Prechelt)
• Integrated Planning and Learning
• Prodigy (Carnegie Mellon University)
• Reinforcement Learning
• Reinforcement Learning: A Tutorial (Mance E. Harmon)
• Reinforcement Learning with Selective Perception and Hidden State (dissertation, Andrew McCallum)
• Reinforcement Learning for Job-Shop Scheduling (dissertation, Wei Zhang)
• Rule Learning
• RIPPER (William Cohen)
• CBA: Classification and Association Rules (Bing Liu)
• Statistical Software
• MODSTAT
• Statistical software (Warren Kovach)
• StatLib: Applied statistics algorithms (Carnegie Mellon University)
• Multiple Regression with Automatic Curve Fitting (James Widdoes)
• R (A clone of Splus; Gerhard Paass)
• Theory Revision (propositional)
• NEITHER (University of Texas at Austin; propositional theory revision)
• Unsupervised Learning
• Autoclass (NASA Ames)
• Autoclass V3.1 C Program
• CViz (IBM's cluster visualization software, currently free as of 8/98)
• ECOBWEB (Yoram Reich)
• Fast Fuzzy Cluster (Michael Bickel)
• MCLUST/EMCLUST (Chris Fraley)
• Workbenches
• Kepler (GMD)
• MLC++ Toolbench
• Stanford
• Silicon Graphics
• WEKA Toolbench (University of Waikato)

Special Interest Groups

• SIGKDD: ACM Special Interest Group on Knowledge Discovery in Data
• American Association for Artificial Intelligence (AAAI)
• Artificial Intelligence Research in Environmental Sciences (AIRIES)
• British Computer Society Specialist Group on Expert Systems
• Canadian Society for Computational Studies of Intelligence (CSCSI)
• International Grammatical Inference Community
• European Network of Excellence in ML (MLnet)
• IJCAI Inc.
• Neural Information Processing Systems (NIPS)
• Institute for Operations Research and the Management Sciences (INFORMS)
• Knowledge Discovery Mine
• Meteorology-AI (Eric Jones)
• Robots
• AAAI 1996 Mobile Robot Competition and Exhibition
• ACL Special Interest Group on Natural Language Learning (SIGNLL)
• SOAR Project (University of Southern California)
• Society for AI and Statistics
• Classification Society of North America

Tutorials (and short notes)

---

Credits

Thanks for your feedback, and to NCARAI, NRL's AI Center, for providing computing support for this WWW page, maintained by David W. Aha. See also the CBR Resources Page.