Expert: deep learning and AI · Ethics, privacy and careers · topic 62 of 62 · 40 min
Capstone: an end-to-end project
Explanation
Why a capstone?
Each module taught one skill. Real work needs all of them in the right order, and the hard parts often sit between modules: deciding which data is good enough, choosing a metric the business accepts, explaining a model's limits. The capstone is your chance to practise those joins, and it becomes the centrepiece of your portfolio.
Pick a good question
- Useful: someone would act on the answer.
- Answerable: data exists, or you can collect it ethically in a few weeks.
- Small enough: finishable in 3–4 weeks at an hour a day.
Example ideas: predict which food-delivery orders will be late (classification), forecast weekly vegetable prices in a mandi (regression or time series), classify customer support tickets into teams (NLP), or build a RAG assistant over your college's rules and timetables (generative AI).
The steps, with the module that covers each
| Step | What to do | Module |
|---|---|---|
| 1. Frame | Question, user, decision, metric, baseline idea | 5 |
| 2. Data | Source, licence, consent; load with code | 1 |
| 3. Clean | Missing values, duplicates, types, outliers; keep raw data unchanged | 4 |
| 4. Explore | EDA checklist, charts, notes of findings | 2, 4 |
| 5. Split | Train/validation/test, or a time split; check for leakage | 6 |
| 6. Baseline | Mean or majority, or a simple rule | 5 |
| 7. Models | Two or three sensible candidates in pipelines | 5, 7, 8 (9–11 if relevant) |
| 8. Evaluate | The chosen metric with cross-validation, then the test set once | 6 |
| 9. Responsible checks | Performance per group, privacy review, failure cases | 11, 12 |
| 10. Present | README, charts, a 2-page summary, optional demo | 12 |
Plan your time
At one hour a day, a sensible split for a four-week capstone is: week 1 for framing, data and cleaning; week 2 for exploration, the split and the baseline; week 3 for models and evaluation; week 4 for responsible-AI checks, the write-up and a demo. Write notes every day as you go. Most learners run out of time at the end, so start the README in week 1 and fill it in as each step finishes.
Presenting results
Lead with the answer, not the method: "The model flags 62% of late orders an hour early, at 80% precision, against 41% for the simple rule." Then show how you know (evaluation), what could go wrong (limitations, fairness, data gaps) and what you would do next. A non-technical reader should understand the first paragraph.
Summary
- Question: can we flag late deliveries 30 minutes before the promised time?
- Result: recall 0.62 at precision 0.80 on the last month (baseline rule: 0.41).
- Biggest signals: restaurant prep time, rain, rider distance.
- Limits: 3 months of data from one city; festival days under-represented.
- Next: add more cities, retrain monthly, monitor drift.Common mistakes
- Choosing a question so big it never finishes. Shrink the scope.
- Spending all the time on models and none on data and evaluation.
- Ending with code only. Always write the summary.
- Skipping the responsible-AI checks because "it is just a project".
Need help?
Stuck on a word or an idea? Search this course, or every course, and jump straight to the explanation or a worked question.
Try:
Watch the lesson
Capstone: an end-to-end project · 1/6
The capstone puts the whole course together in one real project.
Prefer a video by a teacher? Find free videos on “end to end data science project walkthrough capstone” on YouTube ↗
In real life: Capstone: mandi price forecasts
A learner forecasts next week's onion prices in three mandis using public daily arrivals and price data. He cleans gaps from holidays, compares a "same as last week" baseline with a gradient boosting model using lagged prices and arrivals, evaluates with a time-based split and MAE in ₹ per quintal, and explains that the model fails during sudden export-policy changes. His write-up, honest about limits, becomes the project every interviewer asks about.
Practice (0/2 done)
Plan your capstone on one page: the question and user, the data source, the metric and baseline, two candidate models, how you will split and evaluate, one fairness or privacy check, and how you will present the result.
A mini capstone check. Rows are dicts with "rain" (True/False) and "late" (1 or 0). Write compare(rows) that returns a tuple (baseline_acc, rule_acc), both rounded to 4 decimal places: baseline_acc is the accuracy of always predicting the majority value of "late" (ties → 0); rule_acc is the accuracy of predicting late = 1 exactly when rain is True. Return (0.0, 0.0) for no rows.
Quick quiz
Read more (free)
Related help
Before this, learn
This topic builds on these. If something here feels new, open them first.
Related topics
- Career paths: analyst, scientist, ML engineer, AI engineerEthics, privacy and careers · same module
- Privacy and data protectionEthics, privacy and careers · same module
- Capstone project briefFull-Stack Development · Capstone, portfolio and getting work
- Capstone project: from commit to monitored productionDevOps: Git, Docker, Kubernetes and CI/CD · GitOps, platform engineering and DevOps careers
- Portfolio and next stepsFlutter and Dart · Flutter careers and interviews
- Portfolio, open source and a learning planRust Programming · Rust careers and interviews
Questions people ask about this
Open a question to see the answer and why. The first ones are this topic's own quiz, so try the quiz above before you peek.
Which capstone question is best scoped?
Answer: "Flag delivery orders likely to be late 30 minutes early, for one city, using 3 months of data"
Specific, useful and finishable.
Where should a results summary start?
Answer: With the answer and how good it is compared with the baseline
Readers need the answer first.
Your model is only slightly better than the simple rule. What should the write-up say?
Answer: Report both honestly and discuss whether the extra complexity is worth it
Honest comparison is a strength in a portfolio.
Which step catches the most expensive silent errors in a capstone?
Answer: Checking the split for leakage and evaluating on untouched test data
Leakage and test-set misuse make results meaningless.
Which project is a good size for the capstone?Related
Answer: A flatmate expense splitter with login, groups, expenses, search and a settlement list
It has users, a few related tables, ownership and real features, and it can be finished well in four weeks.
Which setting stops anyone pushing straight to main in your capstone repository?Related
Answer: Branch protection (or a ruleset) requiring pull requests
Branch protection rules or rulesets require pull requests and passing checks before merging.
What is a baseline model?Related
Answer: A deliberately simple prediction that sets the bar to beat
Baselines like "predict the mean" tell you whether a real model adds value.
Why include a web demo link?Related
Answer: Reviewers can try the app instantly without installing
Lower effort for reviewers.
Pass the quiz (60% or more) or mark this topic as done when you are ready.
Your progress is saved on this device only.
Next steps
- This is the last topic of “Ethics, privacy and careers”. The module exam comes next.
- Module 12 exam: Ethics, privacy and careers · 12 questions · 20 min, without help. 5 topics of this module still to finish first.
- 62 topics left in the course before the final exam.