Course Introduction

journeycartAI and Robotics

Oct 15, 2013 (4 years and 2 months ago)

129 views

CpSc 881: Machine Learning

Introduction


2

Copy Right Notice

Most slides in this presentation are
adopted from slides of text book and
various sources. The Copyright belong to
the original authors. Thanks!

3

General Information

Class Time
:

2:00 PM ~ 3:15AM TTH

Location
:

Poole C127

Instructor:

Dr. Feng Luo

Office:


310 McAdams Hall

Phone
:


864
-
656
-
4793

Email
:


luofeng@clemson.edu


Office Hours
:

3:30PM ~ 4:30PM TTH

Web site
:

http://www.cs.clemson.edu/~luofeng/course/2013fall/810/machinelearnin
g.html

4

Prerequisite

Familiarity with basic computer
science principles and skills.

Familiarity with the basic
mathematics, like probability
theory, basic linear algebra.

5

Text Book

Tom Mitchell.
Machine Learning
, 1997.
ISBN 0
-
07
-
042807
-
7, WCB/McGraw
-
Hill


Reference books:

Ethem Alpaydin.
Introduction to Machine
Learning
, 2004. ISBN: 0
-
262
-
01211
-
1, the MIT
Press.

Nils J. Nilsson Introduction to Machine
Learning,
(http://robotics.stanford.edu/people/nilsson/mlb
ook.html)


6

Grading

Grading:

Mid
-
term exam



25 %

Final exam




25 %

Term project




50 %

A: >=90

B: >=80

C: >=70

D: >=60

F: <60


7

Resources: Datasets

UCI Repository:
http://www.ics.uci.edu/~mlearn/MLRepository.html

UCI KDD Archive:
http://kdd.ics.uci.edu/summary.data.application.html

Statlib:
http://lib.stat.cmu.edu/

Delve:
http://www.cs.utoronto.ca/~delve/

8

Tools

Weka
(http://www.cs.waikato.ac.nz/ml/weka/)

R (http://www.r
-
project.org/)

Octave: A free matlab clone
(http://www.gnu.org/software/octave/)

Machine Learning Tools in Java
(http://sourceforge.net/projects/mldev/)


9

Resources: Journals

Journal of Machine Learning Research
www.jmlr.org

Machine Learning

Neural Computation

Neural Networks

IEEE Transactions on Neural Networks

IEEE Transactions on Pattern Analysis and
Machine Intelligence

Annals of Statistics

Journal of the American Statistical Association

10

Resources: Conferences

International Conference on Machine Learning (ICML)

ICML05:
http://icml.ais.fraunhofer.de/

European Conference on Machine Learning (ECML)

ECML05:
http://ecmlpkdd05.liacc.up.pt/

Neural Information Processing Systems (NIPS)

NIPS05:
http://nips.cc/

Uncertainty in Artificial Intelligence (UAI)

UAI05:
http://www.cs.toronto.edu/uai2005/

Computational Learning Theory (COLT)

COLT05:
http://learningtheory.org/colt2005/

International Joint Conference on Artificial Intelligence (IJCAI)

IJCAI05:
http://ijcai05.csd.abdn.ac.uk/

International Conference on Neural Networks (Europe)

ICANN05: http://www.ibspan.waw.pl/ICANN
-
2005/

11

What is Machine Learning

Definition


Computing Dictionary:

The ability of a machine to improve its performance based on
previous results.

12

Why Machine Learning

Human expertise does not exist (navigating
on Mars)

Humans are unable to explain their
expertise (speech recognition)

Solution changes in time (routing on a
computer network)

Solution needs to be adapted to particular
cases (user biometrics)


13

Three niches for machine learning

Data Mining: using historical data to
improve decisions

Medical records
-
> medical knowledge

Software application we can NOT program
by hand

Autonomous driving

Speech recognition

Self customizing programs

News reader that learns user interests

14

Applications of Machine
Learning

Information filtering/classification

15

Applications of Machine
Learning

Playing games

16

Applications of Machine
Learning

Robotics

17

Applications of Machine
Learning

fault detection/monitoring
technical systems

18

Applications of Machine
Learning

bioinformatics

19

Applications of Machine
Learning

image classification
picture processing

20

Applications of Machine
Learning

Text/language
processing,
classification,
visualization, ...

21

Applications of Machine
Learning

22

Connections of Machine
Learning

ML

AI

Neurobiology

Control

Statistics

Optimization

Information theory

Psychology

Philosophy