CSCI 5434: Probability for Computer Science
Instructor
Name: Daniel Acuna
Email: daniel.acuna@colorado.edu
Department of Computer Science, ECOT 826
Office Hours: Tuesday 11:00 AM - noon, or by appoint
TA: Meysam Varasteh (Meysam.Varasteh@colorado.edu)
TA Office Hours: Wednesdays, 2:00 PM to 3:00 PM or by appointment.
Instructor Bio
Professor Daniel Acuna is an Associate Professor in the Department of Computer Science at the University of Colorado at Boulder. He leads the Science of Science and Computational Discovery Lab . He works in science of science, a subfield of computational social science, and A.I. for science. He writes papers and builds web-based software tools to accelerate knowledge discovery.
Class time and location
Class Time: Tuesdays and Thursdays, 9:30 AM - 10:45 AM
Physical location: ECCS 1B28
If you are a remote student (002 section, use the Zoom link to the left)
Communication Policies
- Asynchronous participation is allowed in the B section, but those in the main section are expected to attend and participate in person.
- When asking a question during class time or office hours, Zoom students are encouraged to turn on their video.
- In this course, Piazza is the preferred method of communication. Please submit ALL course-related questions on Piazza (setting up an account is free). Piazza also allows you to participate in the course by answering other student's questions. Course announcements will also be made on Piazza (not on Canvas). Please check the Piazza course page often. The instructors will not be answering Piazza questions on evenings and weekends. During the week, they will try to respond within 24 hours. Your fellow students may respond sooner.
- It is recommended that the question be viewable to all students, as other students will likely benefit from the answer.
- Note: anonymous posts on Piazza will not be anonymous to the instructors but will hide your name from fellow students.
- For urgent or personal matters, for example, special circumstances or medical issues, you may email the professor directly. Please include 5434 in the subject line, and optionally, "time-sensitive" or "URGENT" (only in urgent circumstances).
Course Description
This course will introduce topics in probability and statistics that will be useful in other computer science courses. Basic concepts in probability will be taught from an algorithmic and computational point of view, with examples drawn from computer science. Students will gain tools for reasoning under uncertainty. This course serves as helpful background for Artificial Intelligence, Machine Learning, Robotics, Natural Language Processing, Randomized Algorithms, topics in Security, as well as other Computer Science courses involving probability and statistics.
Course Objectives
Students will develop solid understanding of introductory probability theory, in both discrete and continuous domains, for both univariate and multivariate distributions. Students will develop mathematical reasoning skills needed to solve problems involving uncertainty. Students will also gain understanding and develop mathematical skills (both computational and analytical) in a variety of concepts and techniques that make use of probability and statistics, and are strongly related to many areas of computer science. Students will be exposed to derivations and proofs, and develop the ability to perform probabilistic analysis of algorithms.
Textbooks and Readings
- Readings are listed on the schedule and should be done before coming to lecture.
- The primary required textbook for the course will be: Dimitri P. Bertsekas and John N. Tsitsiklis: Introduction to Probability (2nd Edition). Athena Scientific, 2008.
- Other readings will be listed on the schedule, typically available online for free download.
- Students might also find the following text helpful, and it is available for free download here Grinstead and Snell: Introduction to Probability. American Mathematical Society, 2006.
Course Schedule
The high-level weekly outline is as follows (subject to changes and adjustments)
- Week 0-1: Introduction, Probability spaces.
- Week 2: Discrete random variables
- Week 3-4: Expectation, mean, and variance
- Week 5: Continuous random variables
- Week 6-7: Conditional probability and independence, Correlation and covariance
- Week 8: Bounds on probabilities. Law of Large Numbers and Central Limit Theorem, Information and entropy
- Week 9: Applications to compression, coding, and information theory
- Week 10: Inference (including Bayesian inference), parameter estimation
- Week 11-13: Markov chains
- Week 14-15: Introduction to randomized algorithms and probabilistic analysis
Preparation
Students should feel comfortable with Discrete Mathematics (or Structures) and Calculus. This would correspond to having taken Discrete Structures (CSCI 2824), and Multivariable Calculus (APPM 2350 or Math 2400), at CU, or their equivalents elsewhere. Calculus 2 (APPM 1360 or Math 2300, or equivalent) is adequate for the Calculus requirement if you are willing to study multivariate integrals and differentiation independently. Students with non-traditional preparation should ask the instructor.
Coursework & Grading
- 7 Homeworks. These are not to be turned in, however they will help you prepare for the quizzes and exams.
- 6 quizzes; your lowest quiz grade is dropped. Your best 5 quiz grades contribute 30% to the course grade. If two or more quizzes are not turned in, you will fail the class.
- Midterm Exam on Tuesday March 12th, worth 30% of the course grade.
- Final Exam on May 5th, worth 35% of the course grade.
- 5% In-class exercises & participation. There will be some pencil-and-paper exercises given in lecture. Sometimes you will be asked to complete these exercises in groups, sometimes on your own. These exercises will be graded based on effort. It's ok to get the wrong answer, but you need to show that you tried. Class participation also contributes to your grade, including course attendance, asking questions, and communicating on Piazza (e.g., asking questions and answering other students' questions).
Grading scale
Letter Percentage
A 94% to 100%
A- 90% to < 94%
B+ 87% to < 90%
B 83% to < 87%
B- 80% to < 83%
C+ 77% to < 80%
C 73% to < 77%
C- 70% to < 73%
D+ 67% to < 70%
D 63% to < 67%
D- 60% to < 63%
F 0% to < 60%
Advice for success in this course
- Complete the assigned readings before each lecture. Readings are listed on the schedule; check the schedule often for changes/updates.
- Start the homeworks early. You are highly encouraged to form study groups of 2-4 students, and discuss the homework problems together once you have attempted them on your own. You will need to master the skills to solve the homework problems, in order to prepare for the quizzes and exams.
- Ask and answer questions on Piazza. Helping to answer questions can help you solidify your own understanding.
- Attend office hours to clarify remaining questions.
Course Policies
Diversity and Inclusion
The University of Colorado Boulder is committed to the values of Inclusive Excellence .
The Department of Computer Science consists of faculty, staff and students dedicated to antiracism, diversity, equity and inclusion. We value the innovation that multiple perspectives and backgrounds bring to our community, and we are building a culture where everyone’s diversity—race, gender, sexual orientation, age, religion, identity, experience and more—is valued. In this culture, everyone feels a sense of belonging and is able to participate in the department’s research and teaching missions, as well as its initiatives and decision making. We support each other so that all may succeed in achieving their professional and academic goals and positively impact our communities. We are committed to cultivating an environment that integrates antiracism and equity in all that we do.
Electronic Device Policy (for in-person classes)
- No cell phone / smartphone use (please turn it off before entering the classroom).
- Unless otherwise stated, tablets may be used, for course-related purposes, when kept flat on the desk.
- Laptops or tablets with vertical or slanted screens are restricted to the back three (3) rows of the lecture hall, to avoid distracting other students. NOTE: This was a specific student request to CU CEAS faculty.
- When in doubt, if your screen could be viewed by other students and cause a distraction, then please sit towards the back of the room.
- Unless otherwise stated, laptop use is allowed and encouraged during Hands-on exercises.
Netiquette
All students should be aware that their behavior impacts other people, even online. I hope that we will all strive to develop a positive and supportive environment and will be courteous to fellow students and your instructor. Due to the nature of the online environment, there are some things to remember. (Netiquette list compiled by Melissa Landin, Instructor, Dept. of Communication, Inver Hills Community College, mlandin@inverhills.edu; Website: http://www.albion.com/netiquette/corerules.html
- Always think before you write. In other words, without the use of nonverbals with your message, your message can be misinterpreted. So please think twice before you hit submit.
- Keep it relevant. There are places to chat and post for fun everyday stuff. Do not stray from the discussion in the assigned questions.
- Never use all caps. This is the equivalent of yelling in the online world. It is not fun to read. Only use capital letters when appropriate.
- Make sure that you are using appropriate grammar and structure. In other words, I don’t want to see anyone writing “R U” instead of “are you”. There are people in the class that may not understand this type of abbreviation, not to mention it does nothing to help expand your writing and vocabulary skills. Emoticons are fine as long as they are appropriate. A smile ☺ is welcome, anything offensive is not.
- Treat people the same as you would face-to-face. In other words, it is easy to hide behind the computer. In some cases, it empowers people to treat others in ways they would not in person. Remember there is a person behind the name on your screen. Treat all with dignity and respect and you can expect that in return.
- Respect the time of others. This class is going to require you to work in groups. Learn to respect the time of others in your group and your experience will be much better. Always remember that you are not the only person with a busy schedule, be flexible. Do not procrastinate! You may be one that works best with the pressures of the deadline looming on you, but others may not be that way. The same is true for the reverse. The key to a successful group is organization, communication and a willingness to do what it takes to get it done.
University of Colorado Boulder Required Syllabus Statements
Classroom Behavior
Both students and faculty are responsible for maintaining an appropriate learning environment in all instructional settings, whether in person, remote or online. Those who fail to adhere to such behavioral standards may be subject to discipline. Professional courtesy and sensitivity are especially important with respect to individuals and topics dealing with race, color, national origin, sex, pregnancy, age, disability, creed, religion, sexual orientation, gender identity, gender expression, veteran status, political affiliation or political philosophy. For more information, see the policies on classroom behavior and the Student Conduct & Conflict Resolution policies.
Requirements for COVID-19
As a matter of public health and safety, all members of the CU Boulder community and all visitors to campus must follow university, department and building requirements and all public health orders in place to reduce the risk of spreading infectious disease. Students who fail to adhere to these requirements will be asked to leave class, and students who do not leave class when asked or who refuse to comply with these requirements will be referred to Student Conduct and Conflict Resolution. For more information, see the policy on classroom behavior and the Student Code of Conduct. If you require accommodation because a disability prevents you from fulfilling these safety measures, please follow the steps in the “Accommodation for Disabilities” statement on this syllabus.
CU Boulder currently requires masks in classrooms and laboratories regardless of vaccination status. This requirement is a precaution to supplement CU Boulder’s COVID-19 vaccine requirement. Exemptions include individuals who cannot medically tolerate a face covering, as well as those who are hearing-impaired or otherwise disabled or who are communicating with someone who is hearing-impaired or otherwise disabled and where the ability to see the mouth is essential to communication. If you qualify for a mask-related accommodation, please follow the steps in the “Accommodation for Disabilities” statement on this syllabus. In addition, vaccinated instructional faculty who are engaged in an indoor instructional activity and are separated by at least 6 feet from the nearest person are exempt from wearing masks if they so choose.
If you feel ill and think you might have COVID-19, if you have tested positive for COVID-19, or if you are unvaccinated or partially vaccinated and have been in close contact with someone who has COVID-19, you should stay home and follow the further guidance of the Public Health Office (contacttracing@colorado.edu). If you are fully vaccinated and have been in close contact with someone who has COVID-19, you do not need to stay home; rather, you should self-monitor for symptoms and follow the further guidance of the Public Health Office (contacttracing@colorado.edu).
Accommodation for Disabilities
If you qualify for accommodations because of a disability, please submit your accommodation letter from Disability Services to your faculty member in a timely manner so that your needs can be addressed. Disability Services determines accommodations based on documented disabilities in the academic environment. Information on requesting accommodations is located on the Disability Services website . Contact Disability Services at 303-492-8671 or dsinfo@colorado.edu for further assistance. If you have a temporary medical condition, see Temporary Medical Conditions on the Disability Services website.
Preferred Student Names and Pronouns
CU Boulder recognizes that students' legal information doesn't always align with how they identify. Students may update their preferred names and pronouns via the student portal; those preferred names and pronouns are listed on instructors' class rosters. In the absence of such updates, the name that appears on the class roster is the student's legal name.
Honor Code
All students enrolled in a University of Colorado Boulder course are responsible for knowing and adhering to the Honor Code academic integrity policy. Violations of the Honor Code may include, but are not limited to: plagiarism, cheating, fabrication, lying, bribery, threat, unauthorized access to academic materials, clicker fraud, submitting the same or similar work in more than one course without permission from all course instructors involved, and aiding academic dishonesty. All incidents of academic misconduct will be reported to the Honor Code (honor@colorado.edu; 303-492-5550). Students found responsible for violating the academic integrity policy will be subject to nonacademic sanctions from the Honor Code as well as academic sanctions from the faculty member. Additional information regarding the Honor Code academic integrity policy can be found on the Honor Code website.
Sexual Misconduct, Discrimination, Harassment and/or Related Retaliation
CU Boulder is committed to fostering an inclusive and welcoming learning, working, and living environment. The university will not tolerate acts of sexual misconduct (harassment, exploitation, and assault), intimate partner violence (dating or domestic violence), stalking, or protected-class discrimination or harassment by or against members of our community. Individuals who believe they have been subject to misconduct or retaliatory actions for reporting a concern should contact the Office of Institutional Equity and Compliance (OIEC) at 303-492-2127 or email cureport@colorado.edu. Information about university policies, reporting options, and the support resources can be found on the OIEC website .
Please know that faculty and graduate instructors have a responsibility to inform OIEC when they are made aware of incidents of sexual misconduct, dating and domestic violence, stalking, discrimination, harassment and/or related retaliation, to ensure that individuals impacted receive information about their rights, support resources, and reporting options. To learn more about reporting and support options for a variety of concerns, visit Don’t Ignore It .
Religious Holidays
Campus policy regarding religious observances requires that faculty make every effort to deal reasonably and fairly with all students who, because of religious obligations, have conflicts with scheduled exams, assignments or required attendance.
See the campus policy regarding religious observances for full details.
Canvas Policies
Canvas Privacy Policy
You can find a copy of the Canvas Privacy Policy on the Instructure Product Privacy Policy page.
Canvas Accessibility Statement
You can find a copy of the Canvas Accessibility Statement on the Accessibility within Canvas page.