CSE 455/555 Introduction to Pattern Recognition
|Instructor:||Jason Corso (UBIT: jcorso)|
|Meeting Times:||MWF 11-12|
|Teaching Assistant:||Wenyuan Yin (UBIT: wyin4) and Yingbo Zhou (UBIT: yingbozh)|
Instructor: Wednesday 12-2 in Bell 246
TA Yingbo: Monday 3-6 in Bell 232
TA Wenyuan: Tuesday 3-5 and Friday 9-10 in Bell 232
|A Note On Contacting The Instructor:||You are encouraged to contact the instructor or TA via the newsgroup. If you choose email, then you must 1) send the email from a buffalo.edu address and 2) include [CSE555] at the beginning of the command-line. Email that does not follow these conventions will not be read.|
The calendar will be populated as the semester proceeds based on the
above course outline and our progress.
Slides are linked off of the week number on the left column. These will be updated as the semester proceeds. Note, for each of the sections outlined in the course outline there will be only a single set of slides.
|0||1/19||Introduction||PR Application in Robotics||Ch. 1|
|1||1/24||Bayesian Decision Theory||Bayesian Decision Theory||MLE||Ch. 2,3||HW 1 Out|
|2||1/31||Bayesian Parameter Estimation||Curse of Dimensionality||Ch. 3 Trunk|
|3||2/7||PCA||FLD||Faces Case Study||Ch. 3
Turk and Pentland
Belhumeur et al.
Martinez and Kak
|HW 2 Out|
|4||2/14||Faces Case Study, IMPCA, MDA||IMPCA, MDA
|Nonlinear Methods (LLE)||Ch. 3
Yang and Yang
Saul and Roweis
|HW 1 Due|
|5||2/21||Non-Linear Methods (Dr. Raymond Fu)||Mixture Distributions and Computational Finance Applications||
Saul and Roweis
|6||2/28||Discriminant Functions||HMMs (Guest: Platt)||Discriminant Functions/Perceptron||Ch. 5||HW 2 Due
HW 3 out
|7||3/7||Discriminants||Discriminants in Matlab||Mid-Term Exam In Class||Ch. 5|
|3/14||Spring Recess - No Classes|
|8||3/21||SVM||HMM||HMM / DBN||
Ghahramani HMM/BN Tutorial
Rabiner HMM Tutorial
DBNs (from K. Murphy)
DBN Chapter (from K. Murphy)
HW 3 Due
|10||4/4||Non-parametric Density Estimation||Non-parametric Density Estimation||Non-parametric Density Estimation||Ch. 4
Zhao and Davis
|11||4/11||Decision Trees / Syntactical||Decision Trees / Syntactical||Class Cancelled for CSE GSA Conference (Department Policy)||Ch. 8|
|12||4/18||Decision Trees / Syntactical||Boosting/AdaBoost||Boosting/AdaBoost||
Viola and Jones
|13||4/25||Bias and Variance||Resampling Methods||Cross-Validation and Bagging||Ch. 9|
|14||5/2||Review and Project Discussion||Reading Day||Reading Day||Projects Due (5/2)|
|Final Exam: TBD|
Prerequisites: It is assumed the students have a working knowledge of calculus, linear algebra, and probability theory.
Course Goals: After taking the course, the student should have a clear understanding of 1) the design and construction and a pattern recognition system and 2) the major approaches in statistical and syntactic pattern recognition. The student should also have some exposure to the theoretical issues involved in pattern recognition system design such as the curse of dimensionality. These goals are evaluated through the course project, homeworks, and exams.
Textbooks: The main (required) textbook for the course is
Recommended supplemental textbooks are
The following is the list of topics we will cover this semester. The selection of topics has been made to provide the student with both a fair sampling and an indepth, useful know-how of the big field of pattern recognition. This has required that we drop some topics completely (e.g., Neural Networks) to allow for more indepth discussion of other topics (e.g., Dimension Reduction).
Homeworks: There will be three homeworks, equally weighted. They will cover both theoretical and practical (implementation) aspects of the material. Students may collectively discuss the homework problems, but they must write them independently.
No sharing any of source code or written/typed materials is permitted. No stealing of any source code or written/typed materials off of the internet is permitted. No utilization of any third-party libraries, other than those explicitly mentioned in the assignment description, is permitted. Refer to the Academic Integrity statement at the end of the syllabus for more information; a zero tolerance policy on cheating will be adopted in this course. This means simply if you cheat once you will get an F.
Course Project: Each student will be required to implement a course project during the second half of the semester. Projects are not in groups, but again, discussion is permitted--however, actual working must be done alone (programming and writing). A report and five-minute demonstration of the project (to the instructor and TA) is required at the end of the semester. The project will be officially assigned immediately following spring break, and the instructor will provide 3 possible course projects including example data to work with. For example, one possible project may be to implement an AdaBoost face detector. However, students, especially those involved in or interested in pursuing research, are encouraged to pursue projects of their own design. Such a project must be discussed in person with the instructor during the first half of the semester to ensure the project is suitable.
No sharing any of source code or written/typed materials is permitted. No stealing of any source code or written/typed materials off of the internet is permitted. No utilization of any third-party libraries, other than those explicitly mentioned in the project description, is permitted. Refer to the Academic Integrity statement at the end of the syllabus for more information; a zero tolerance policy on cheating will be adopted in this course. This means simply if you cheat once you will get an F.
Programming Language and Source Code: For some homeworks and for the course project, programming will be required. Students must independently complete all programming assignments and turn in compilable/executable code. Students may choose the language from the following: Matlab 7+, Java 1.5+, and C/C++. However, your code must both compile and run on the CSE linux network (e.g., nickelback.cse.buffalo.edu).
A final percentage score will be calculated as a weighted average of the course work according to the following table:
Letter grades will be given in the range of F to A (with minuses and pluses). Mapping of raw percentage scores to letter grades will be based on the following rubric: Letter grade A is given for raw percentage scores of 87.5 and higher for 555 and 85 and higher for 455. Remaining letter scores are graded based on a clustering of the students output with each cluster mean mapped to a letter grade in decreasing order (essentially, this means graded on a curve); this is based on overall class performance.
Distinctions 455 and 555 grading: 455 and 555 will be graded on separate curves and the mapping to grade A is different. In addition, 455 students will be required to solve fewer problems on the exams, the specified amount will be determined per exam.
Late Work and Missed Exam Policy: No late work will be accepted. Ample time will be given to complete both the homeworks and the project; use it wisely. Similarly, the date of the exams will be known far in advance. Do not miss the exam. No make-up exams will be given other than for those University approved reasons. This is a firm policy. Do not expect special treatment.
Regrading: If you have a question about the grading of any piece of work, first consult with the teaching assistant who graded your work. If you cannot resolve your questions with the teaching assistant, you should consult with the instructor of the course.
Any questions about the grading of a piece of work must be raised within one week of the date that the work was returned by the teaching assistant or the instructor. In other words, if you do not pick up your work in a timely fashion, you may forfeit your right to question the grading of your work.
Incomplete ("I") Grades: Generally, incomplete ("I") grades are not given. However, very rarely, circumstances truly beyond a studentÕs control prevents him or her from completing work in the course. In such cases the instructor can give a grade of "I." The student will be given instructions and a deadline for completing the work, usually no more than 30 days past the end of the semester. University and department policy dictate that "I" grades can be given only if the following conditions are met:
Incompletes can not be given as a shelter from poor grades. It is your responsibility to make a timely resignation from the course if you are doing poorly for any reason. The last day to resign the course is Friday, March 27 2009.
Newsgroup: There is a newsgroup, sunyab.cse.555, for this course. You must learn how to read news and subscribe to this newsgroup. You are expected to read the newsgroup on a daily basis. There will often be important material posted there, such as supplementary course notes, homework and sample exam questions, and occasionally late breaking news. You may post general course related articles to the newsgroup. Use discretion in posting articles related to homework assignments and the project: when in doubt, e-mail the TA or instructor first.
The news (nntp) server you need to connect to is news.buffalo.edu. Note that you must authenticate using your UBIT name and password to use this news server, and you must be connecting from a UB IP address (i.e. if you are not using a university machine, you need to use VPN). For further information on accessing the newsgroup, refer to http://ubit.buffalo.edu/newsgroups/index.php.
Similar Courses at This and Other Institutions: (incomplete and in no important order)
If you don't understand something covered in class, ask about it right away. The only silly question is the one which is not asked. If you get a poor mark on an assignment or exam, find out why right away. Don't wait a month before asking. The instructor and teaching assistant are available to answer your questions. Don't be afraid to ask questions, or to approach the instructor or TA in class, during office hours, through the newsgroup or through e-mail. This course is intended to be hard work, but it is also intended to be interesting and fun. We think pattern recognition is interesting and exciting, and we want to convince you of this.
If you have a diagnosed disability (physical, learning, or psychological) that will make it difficult for you to carry out the course work as outlined, or that requires accommodations such as recruiting note-takers, readers, or extended time on exams or assignments, you must consult with the Office of Disability Services (25 Capen Hall, Tel: 645-2608, TTY: 645-2616, Fax: 645-3116, http://www.student-affairs.buffalo.edu/ods/). You must advise your instructor during the Žrst two weeks of the course so that we may review possible arrangements for reasonable accommodations.
Your attention is called to the Counseling Center (645-2720), 120 Richmond Quad. The Counseling Center staff are trained to help you deal with a wide range of issues, including how to study effectively and how to deal with exam-related stress. Services are free and conŽdential. Their web site is http://www.student-affairs.buffalo.edu/shs/ccenter/.
The following is the text of a policy adopted by the Faculty Senate on 5/2/2000. You are expected to know and adhere to this policy.
OBSTRUCTION OR DISRUPTION IN THE CLASSROOM - POLICIES
UNIVERSITY AT BUFFALO
To prevent and respond to distracting behavior faculty should clarify standards for the conduct of class, either in the syllabus, or by referencing the expectations cited in the Student Conduct Regulations. Classroom ``etiquette'' expectations should include:
A zero-tolerance policy on cheating will be adopted in this course. The following is the formal statement of academic integrity. Source: http://www.cse.buffalo.edu/graduate/policies_acad_integrity.php
The academic degrees and the research findings produced by our Department are worth no more than the integrity of the process by which they are gained. If we do not maintain reliably high standards of ethics and integrity in our work and our relationships, we have nothing of value to offer one another or to offer the larger community outside this Department, whether potential employers or fellow scholars.
For this reason, the principles of Academic Integrity have priority over every other consideration in every aspect of our departmental life, and we will defend these principles vigorously. It is essential that every student be fully aware of these principles, what the procedures are by which possible violations are investigated and adjudicated, and what the punishments for these violations are. Wherever they are suspected, potential violations will be investigated and determinations of fact sought. In short, breaches of Academic Integrity will not be tolerated.
The University at Buffalo Department of Computer Science and Engineering endorses and adheres to the University policy on Academic Integrity. Students should be familiar with that policy, as expressed in the following documents.:
The following statement further describes the specific application of these general principles to a common context in the CSE Department environment, the production of source code for project and homework assignments. It should be thoroughly understood before undertaking any cooperative activities or using any other sources in such contexts.
All academic work must be your own. Plagiarism, defined as copying or receiving materials from a source or sources and submitting this material as one's own without acknowledging the particular debts to the source (quotations, paraphrases, basic ideas), or otherwise representing the work of another as one's own, is never allowed. Collaboration, usually evidenced by unjustifiable similarity, is never permitted in individual assignments. Any submitted academic work may be subject to screening by software programs designed to detect evidence of plagiarism or collaboration.
It is your responsibility to maintain the security of your computer accounts and your written work. Do not share passwords with anyone, nor write your password down where it may be seen by others. Do not change permissions to allow others to read your course directories and files. Do not walk away from a workstation without logging out. These are your responsibilities. In groups that collaborate inappropriately, it may be impossible to determine who has offered work to others in the group, who has received work, and who may have inadvertently made their work available to the others by failure to maintain adequate personal security. In such cases, all will be held equally liable.
These policies and interpretations may be augmented by individual instructors for their courses. Always check the handouts and web pages of your course and section for additional guidelines.
Any student accused of a violation of academic integrity will be so notified by the course director. An informal review will be conducted, including a meeting between these parties. After this review and upon determination that a violation has occurred, the following sanctions will be imposed. It is the policy of this department that, in general, any violation of academic integrity will result in an F for the course, that all departmental financial support including teaching assistantship, research assistantship or scholarships be terminated, that notification of this action be placed in the student's confidential departmental record, and that the student be permanently ineligible for future departmental financial support. A second violation of academic integrity will cause the department to seek permanent dismissal from the major and bar from enrollment in any departmental courses. Especially flagrant violations will be considered under formal review proceedings, which may in addition to the above sanctions result in expulsion from the University.