Is MathAcademy Worth It? Thoughts After 2,000 Experience Points (XP)

math education
learning
cognitive science
My review after ~40 hours of dedicated learning on the platform.
Author

Jonathan Whitmore

Published

September 10, 2024

Introduction

For the past two months, I’ve dedicated daily practice to MathAcademy.com, accumulating more than 2,000 experience points (~40 hours of total work).

Main takeaway: MathAcademy is extraordinary.

MathAcademy.com is an online platform that adapts to each student’s learning pace and style, ensuring mastery of mathematical concepts through scientifically-backed methods. Currently ~$50 per month.

In this post, I’ll explore the concept of knowledge retention, introduce you to MathAcademy, and share my personal experience with the platform. I’ll also cover how MathAcademy addresses the challenges of efficient learning and long-term knowledge retention, and why I believe it’s a game-changer for motivated individuals with the goal of learning math.

What is MathAcademy?

MathAcademy is an innovative online learning platform that goes beyond traditional math education methods. It uses adaptive learning algorithms to tailor the learning experience to each student’s current knowledge. Unlike many other platforms, MathAcademy focuses on efficiently teaching true mastery of concepts.

It has offerings for students in 4th grade through university level mathematics (pretty deep into a standard math major curriculum). It has a couple of other paths for different student needs. The Mathematics Foundations series is tailored to adult students who, like me, are mostly re-learning content they “learned” 20 years ago. See this list of courses for a better explanation.

Here’s a tweet from one of the content authors (@ninja_maths) at MathAcademy with more on the Foundations series.

Two more courses that have drawn my attention are the Mathematics for Machine Learning and the Methods of Proof classes. Soon.

The Challenge: Knowledge Retention

Throughout our lives, we’ve gathered countless bits of knowledge, only to watch some of them drift away. Take the rivers of Texas, for example—I once knew them, but now I can’t quite recall which one is the Brazos. And perhaps, like me, you’re perfectly content letting such details fade into the aether*.

*The aether is not real.

But what if the knowledge that slipped away was something you truly cared about?

Years ago, I went to graduate school to get a PhD in physics. One of the significant hurdles along the way was the qualifying exam, known simply as “the qual”. Fast forward a few years, and when the topic of “the qual” came up with my fellow graduate students, we’d lament the skills that we had lost, and wonder if we could still pass it. Some were confident they still had the chops, while others—myself included—suspected we’d need a fair bit of luck.

The physics department at UC San Diego no longer requires “the qual”. I’ve maintained the qualifying exams from 1987–2019 on my personal website since about 2008: UC San Diego, Physics PhD Qualifying Exams.

I felt that losing all that knowledge was incredibly sad. And I knew that all it would take is some dedicated and persistent effort from my side. But I had no idea how much time and effort it would take.

The Cost/Benefit Tradeoff of Knowledge Retention

I wanted to have a good estimate of what the Cost/Benefit tradeoff looked like. If I wanted to retain 90% of my physics knowledge, was it closer to the optimistic or pessimistic curve?

Figure 1: Cost Benefit Tradeoff

If it really was only 5 minutes of daily practice (optimistic curve) to maintain 90% of my physics knowledge and problem-solving skills, I’d easily commit to working on this while drinking my tea in the morning and keep myself 90% sharp. Conversely, if it required 47 minutes per day (pessimistic curve), realistically it wouldn’t be worth it.

But I didn’t have an answer to the question: What is the actual cost for maintaining different levels of knowledge?

This question is crucial because it directly impacts how we approach learning and knowledge retention. If the cost is low, we might be more inclined to maintain a broader range of knowledge. If it’s high, we might need to be more selective about what we choose to retain.

The efficiency of practice is another critical factor. If you could identify the skills that were about to leave your mind and get lost in the abyss*, you could potentially optimize your retention efforts.

*The abyss is not real.

I’ve studied numerous technologies and learning strategies over the years. I’ve used Anki, a popular SRS (Spaced-Repetition Software or Spaced-Retrieval System) program, for years. One of the best mental reframes that I’ve had about Anki comes from Michael Nielsen when he writes, “Anki makes memory a choice.” While Anki is a powerful tool, it’s not the focus of this post.

Anki is a free program (the iOS app is not free) that makes remembering things easy.

Because it’s a lot more efficient than traditional study methods, you can either greatly decrease your time spent studying, or greatly increase the amount you learn. – Anki website.

Going beyond retention

I set this up as a retention focused problem. But the problem is actually much larger. If you can create a system that both teaches and helps you retain what you’ve learned you’ve done something special.

This is where MathAcademy comes back in, offering a solution that addresses both the efficiency of learning and the challenge of long-term retention.

My Experience with MathAcademy

I’ve live-streamed myself working through a few practice sessions, so if you want to see what it looks like (and what I look like while working on it) here’s the session where I completed the Foundations II course:

Adaptive Learning and Progress Tracking

One of the most striking aspects of my MathAcademy experience has been its ability to adapt to my current knowledge level. I began with a diagnostic that identifies areas where I needed more practice, and areas that I already comfortably knew. After the diagnostic I was placed at something like 99% done with Foundations I, and 76% done with the Foundations II course. This personalized approach meant that I was always working at the edge of my abilities, maximizing my learning efficiency.

This point is important so I’ll state it another way. There are many free and high-quality math courses that exist on the internet right now. However, these lectures and videos are aimed at an audience that has a different background knowledge than me. There’s stuff that I already know, and probably things that the lecturer assumes that I know that I might not. So even with high quality courses, I have to spend significant time and effort in filtering the content so that I can actually get to the topics that are actually new to me (or look up something that I was supposed to have learned).

It’s even more cool than that. They’ve developed a way of giving partial credit to lower level skills if you’ve just demonstrated a skill that relies on it. As I understand it, for example, if you do a higher level problem that requires a lower level skill to complete, you get partial reinforcement for that lower level skill. For more details, see: this blog post on Fractional Implicit Repetition.

Further, they aren’t usually paired (as MathAcademy is) in a tight feedback loop with questions that test whether you could apply what you just learned. And finally, there is spaced-repetition built in, so it ensures that as your knowledge is elevated into the heavenly quintessence* before they fade away.

*The heavenly quintessence is not real.

Over my 40 hours of learning, I have completed the Mathematics Foundations II course. I’ve started Mathematics Foundations III, and again, a nice aspect of the site is that it gives an estimate of how many “experience points” it will take me to complete it. It, like Anki, turns a goal that I want to accomplish into something like “turn the effort-crank X times and you’ll have re-learned Linear Algebra to a deep level”.

This approach directly addresses the Cost/Benefit tradeoff we discussed earlier. By optimizing the learning process and providing clear metrics, MathAcademy helps minimize the “cost” side of the equation while maximizing the “benefit” through efficient, targeted learning.

It’s hard to give a good sense of how important that experience is. It’s a similar point that Rory Sutherland has made many times, including here, where he says that the innovation of Uber is not the calling of a cab, but in showing you a real-time map of where your cab is while it’s on your way to pick you up. The act of reducing uncertainty is a very big effect, but it’s hard to appreciate if you’ve just read about it. I think a similar thing is happening with MathAcademy (whether by accident or by design); you know how much effort or time it is until you’ve learned your next goal. It seems like a small thing, but it’s not, it’s really important. And I’ve noticed a number of these things that really make a difference to the student’s experience.

Conclusion: Is it worth it?

After spending two months with MathAcademy, accumulating 2,000 experience points over about 40 hours of learning, I can confidently say that the $50 monthly subscription fee is well worth the investment. Here’s why:

  1. A Tireless Expert Tutor: For less than the cost of a single hour with a private math tutor, MathAcademy provides you with 24/7 access to what is essentially a tireless, expert math tutor. This AI-driven platform doesn’t get fatigued, lose patience, or have scheduling conflicts.
  2. Personalized Learning Path: MathAcademy excels at identifying exactly what you need to work on, zeroing in on your weak spots and areas for improvement.
  3. Mastery Through Practice: The platform provides a seemingly endless supply of practice problems tailored to your skill level, challenging you until you demonstrate true mastery of a concept.
  4. Structured Progression: It creates a clear path forward, eliminating the guesswork and potential gaps in knowledge that can occur with self-directed study.
  5. Long-Term Retention Focus: The platform’s use of spaced repetition and adaptive review ensures that you’re building lasting mathematical knowledge and skills.

MathAcademy has not only helped me relearn and solidify mathematical concepts, but it’s also changed my perspective on what effective learning can look like. It addresses the question of knowledge retention in a way that balances efficiency and thoroughness, making it possible to maintain a high level of skill with manageable daily practice.

When you consider the depth of content, the adaptive technology, and the personalized attention you receive, MathAcademy offers exceptional value. For anyone serious about improving their math skills - whether you’re a student looking to excel in your classes, a professional aiming to enhance your quantitative abilities, or simply someone who wants to reconnect with mathematics - MathAcademy provides a level of instruction and practice that would cost hundreds or even thousands of dollars per month to replicate with traditional tutoring.

Returning to our initial question about the cost of maintaining knowledge, MathAcademy seems to offer a solution that leans towards the optimistic end of the spectrum. While it may not be as quick as “5 minutes a day,” the efficiency and effectiveness of the platform make the time investment highly worthwhile. It transforms the daunting tasks of learning and retaining complex mathematical knowledge into a manageable, even enjoyable, daily practice.

As I continue my journey with MathAcademy, I’m excited to see how much further I can progress and how well I’ll retain this knowledge in the long term. For anyone looking to learn or relearn mathematics, I can’t recommend MathAcademy highly enough. It’s not just a learning tool; it’s a new paradigm in education that makes mathematical mastery achievable for everyone.

One final thought

I am very interested in seeing if the MathAcademy team is thinking about expanding to math-adjacent topics like Physics. If so, I have a person in mind who is knowledgeable about physics, has enthusiastically bought into your overall approach, and has lots of ideas for problems and problem-types.

Acknowledgements

Thank you to Julija Whitmore for reading early drafts of this.