标签: Data Science

  • The Hidden 90% of Machine Learning Engineering

    The Hidden 90% of Machine Learning Engineering

    Hey, if you’re interested in machine learning, you’ve probably heard that building models is just a small part of the job. In fact, it’s often said that model-building is only about 10% of what ML engineers do. The other 90% is made up of tasks like data cleaning, creating feature pipelines, deployment, monitoring, and maintenance. But is this really true?

    As someone who’s starting to learn about ML, it can be a bit misleading. We spend most of our time in school learning about the models themselves, not the surrounding tasks that make them work in the real world. So, how do ML engineers actually get good at the non-model parts of their job? Do they learn it on the job, or is it something you should invest time in to get noticed by potential employers?

    I think the key is to find a balance between learning the theory and models, and the practical skills you need to deploy and maintain them. It’s not just about building a great model; it’s about making it work in the real world. This means learning about data preprocessing, how to create efficient pipelines, and how to deploy your models in a way that’s scalable and reliable.

    Some ways to get started with the non-model aspects of ML engineering include:

    * Learning about data preprocessing and feature engineering
    * Practicing with deployment tools like Docker and Kubernetes
    * Experimenting with monitoring and maintenance techniques
    * Reading about the experiences of other ML engineers and learning from their mistakes

    By focusing on these areas, you can set yourself up for success as an ML engineer and make your models a reality.

  • From Code to Models: Do Machine Learning Experts Come from a Software Engineering Background?

    From Code to Models: Do Machine Learning Experts Come from a Software Engineering Background?

    I’ve often wondered, what’s the typical background of someone who excels in Machine Learning? Do they usually come from a Software Engineering world, or is it a mix of different fields?

    As I dug deeper, I found that many professionals in Machine Learning do have a strong foundation in Software Engineering. It makes sense, considering the amount of coding involved in building and training models. But, it’s not the only path.

    Some people transition into Machine Learning from other areas like mathematics, statistics, or even domain-specific fields like biology or physics. What’s important is having a solid understanding of the underlying concepts, like linear algebra, calculus, and probability.

    So, if you’re interested in Machine Learning but don’t have a Software Engineering background, don’t worry. You can still learn and excel in the field. It might take some extra effort to get up to speed with programming languages like Python or R, but it’s definitely possible.

    On the other hand, if you’re a Software Engineer looking to get into Machine Learning, you’re already ahead of the game. Your coding skills will serve as a strong foundation, and you can focus on learning the Machine Learning concepts and frameworks.

    Either way, it’s an exciting field to be in, with endless opportunities to learn and grow. What’s your background, and how did you get into Machine Learning? I’d love to hear your story.