Skip to content

Expert: deep learning and AI · Ethics, privacy and careers · topic 62 of 62 · 40 min

Capstone: an end-to-end project

Explanation

The capstone puts the whole course together: frame a question, get and clean data, explore it, build a baseline and better models, evaluate them honestly, check fairness and privacy, and present the result clearly, ideally with a small demo. Doing one project end to end teaches more than any single module.

Why a capstone?

Each module taught one skill. Real work needs all of them in the right order, and the hard parts often sit between modules: deciding which data is good enough, choosing a metric the business accepts, explaining a model's limits. The capstone is your chance to practise those joins, and it becomes the centrepiece of your portfolio.

Pick a good question

  • Useful: someone would act on the answer.
  • Answerable: data exists, or you can collect it ethically in a few weeks.
  • Small enough: finishable in 3–4 weeks at an hour a day.

Example ideas: predict which food-delivery orders will be late (classification), forecast weekly vegetable prices in a mandi (regression or time series), classify customer support tickets into teams (NLP), or build a RAG assistant over your college's rules and timetables (generative AI).

The steps, with the module that covers each

StepWhat to doModule
1. FrameQuestion, user, decision, metric, baseline idea5
2. DataSource, licence, consent; load with code1
3. CleanMissing values, duplicates, types, outliers; keep raw data unchanged4
4. ExploreEDA checklist, charts, notes of findings2, 4
5. SplitTrain/validation/test, or a time split; check for leakage6
6. BaselineMean or majority, or a simple rule5
7. ModelsTwo or three sensible candidates in pipelines5, 7, 8 (9–11 if relevant)
8. EvaluateThe chosen metric with cross-validation, then the test set once6
9. Responsible checksPerformance per group, privacy review, failure cases11, 12
10. PresentREADME, charts, a 2-page summary, optional demo12

Plan your time

At one hour a day, a sensible split for a four-week capstone is: week 1 for framing, data and cleaning; week 2 for exploration, the split and the baseline; week 3 for models and evaluation; week 4 for responsible-AI checks, the write-up and a demo. Write notes every day as you go. Most learners run out of time at the end, so start the README in week 1 and fill it in as each step finishes.

Presenting results

Lead with the answer, not the method: "The model flags 62% of late orders an hour early, at 80% precision, against 41% for the simple rule." Then show how you know (evaluation), what could go wrong (limitations, fairness, data gaps) and what you would do next. A non-technical reader should understand the first paragraph.

output
Summary
- Question: can we flag late deliveries 30 minutes before the promised time?
- Result: recall 0.62 at precision 0.80 on the last month (baseline rule: 0.41).
- Biggest signals: restaurant prep time, rain, rider distance.
- Limits: 3 months of data from one city; festival days under-represented.
- Next: add more cities, retrain monthly, monitor drift.
A results summary that leads with the answer. Numbers here are an example.

Common mistakes

  • Choosing a question so big it never finishes. Shrink the scope.
  • Spending all the time on models and none on data and evaluation.
  • Ending with code only. Always write the summary.
  • Skipping the responsible-AI checks because "it is just a project".

Need help?

Stuck on a word or an idea? Search this course, or every course, and jump straight to the explanation or a worked question.

Try:

Watch the lesson

Capstone: an end-to-end project · 1/6

Capstone

The capstone puts the whole course together in one real project.

Prefer a video by a teacher? Find free videos on “end to end data science project walkthrough capstone” on YouTube ↗

In real life: Capstone: mandi price forecasts

A learner forecasts next week's onion prices in three mandis using public daily arrivals and price data. He cleans gaps from holidays, compares a "same as last week" baseline with a gradient boosting model using lagged prices and arrivals, evaluates with a time-based split and MAE in ₹ per quintal, and explains that the model fails during sudden export-policy changes. His write-up, honest about limits, becomes the project every interviewer asks about.

Practice (0/2 done)

Task 1 · Practice

Plan your capstone on one page: the question and user, the data source, the metric and baseline, two candidate models, how you will split and evaluate, one fairness or privacy check, and how you will present the result.

Task 2 · Code · Python

A mini capstone check. Rows are dicts with "rain" (True/False) and "late" (1 or 0). Write compare(rows) that returns a tuple (baseline_acc, rule_acc), both rounded to 4 decimal places: baseline_acc is the accuracy of always predicting the majority value of "late" (ties → 0); rule_acc is the accuracy of predicting late = 1 exactly when rain is True. Return (0.0, 0.0) for no rows.

Quick quiz

Question 1

1.Which capstone question is best scoped?

Question 2

2.Where should a results summary start?

Question 3

3.Your model is only slightly better than the simple rule. What should the write-up say?

Question 4

4.Which step catches the most expensive silent errors in a capstone?

Read more (free)

Open a question to see the answer and why. The first ones are this topic's own quiz, so try the quiz above before you peek.

Which capstone question is best scoped?

Answer: "Flag delivery orders likely to be late 30 minutes early, for one city, using 3 months of data"

Specific, useful and finishable.

Where should a results summary start?

Answer: With the answer and how good it is compared with the baseline

Readers need the answer first.

Your model is only slightly better than the simple rule. What should the write-up say?

Answer: Report both honestly and discuss whether the extra complexity is worth it

Honest comparison is a strength in a portfolio.

Which step catches the most expensive silent errors in a capstone?

Answer: Checking the split for leakage and evaluating on untouched test data

Leakage and test-set misuse make results meaningless.

Which project is a good size for the capstone?Related

Answer: A flatmate expense splitter with login, groups, expenses, search and a settlement list

It has users, a few related tables, ownership and real features, and it can be finished well in four weeks.

From Capstone project brief

Which setting stops anyone pushing straight to main in your capstone repository?Related

Answer: Branch protection (or a ruleset) requiring pull requests

Branch protection rules or rulesets require pull requests and passing checks before merging.

From Capstone project: from commit to monitored production

What is a baseline model?Related

Answer: A deliberately simple prediction that sets the bar to beat

Baselines like "predict the mean" tell you whether a real model adds value.

From The ML workflow end to end

Why include a web demo link?Related

Answer: Reviewers can try the app instantly without installing

Lower effort for reviewers.

From Portfolio and next steps

Pass the quiz (60% or more) or mark this topic as done when you are ready.

Your progress is saved on this device only.

Next steps

  1. This is the last topic of “Ethics, privacy and careers”. The module exam comes next.
  2. Module 12 exam: Ethics, privacy and careers · 12 questions · 20 min, without help. 5 topics of this module still to finish first.
  3. 62 topics left in the course before the final exam.

← Previous: Portfolio, projects and interviews