Author: Fritz

Joseph Redmon released a series of 20 lectures on computer vision in September (2018). As he is an expert in the field, I wrote a lot of notes while going through his lectures. I am tidying my notes for my own future reference but will post them on Medium also in case these are useful for others.

His first lecture is an introduction in which he details the differences, methods and applications of low, mid, and high level computer vision (CV).

Continue reading “The Ancient Secrets of Computer Vision 1 by Joseph Redmon – Condensed”

With over 210 million daily active users, Snapchat remains one of the top applications that people use to enjoy augmented reality experiences. The app’s wide variety of AR features lets users do everything, from giving their digital selves some doggie ears to adding realistic 3D effects and transformations.

Snap has always been proactive about letting people come up with new ideas and designs, with Lens Studio allowing developers to “create, publish, and share Lenses” across the platform. To date, Snap reports over 1 million custom Lenses created.

Continue reading “SnapML in Lens Studio: Using custom machine learning models to power AR experiences”

In the previous post in this series on working with forms in React Native, you did a lot of things—from creating Login and Signup forms from scratch, to using powerful libraries like Formik and Yup, to validating those forms.

In this tutorial, let’s extend our knowledge of building and validating forms by handling different input field types other than strings. You’re also going to see my solution for how to gracefully create a Confirm Password field and validate it using the reference of the already set up password field.

Continue reading “Handling different field types in React Native forms with Formik and Yup”

In the previous post in this series on working with forms in React Native, you did a lot of things—from creating Login and Signup forms from scratch, to using powerful libraries like Formik and Yup, to validating those forms.

In this tutorial, let’s extend our knowledge of building and validating forms by handling different input field types other than strings. You’re also going to see my solution for how to gracefully create a Confirm Password field and validate it using the reference of the already set up password field.

Continue reading “Handling different field types in React Native forms with Formik and Yup”

Most smartphones come with a sensor of some sort: Gyroscope, accelerometer, ambient light, proximity, GPS, among others. These sensors each have their own functions, ranging from detecting the your phone’s orientation to determining your current position on the globe.

In this tutorial, we’ll take a look at how we can use the phone’s accelerometer to move a ball through a maze. We will be using React Native to create the app. For the accelerometer data, we’ll employ the help of React Native Sensors and build the game with MatterJS and React Native Game Engine.

Continue reading “Creating an accelerometer-powered maze game in React Native”

At WWDC18, Apple announced an exciting new addition to their machine learning frameworks, Create ML. Create ML gives developers an easy way to create custom, lightweight machine learning models within Xcode.

When combined with existing frameworks such as Core ML and Vision, iOS developers (even those without prior knowledge of machine learning) can create apps that use custom models they built themselves.

Continue reading “Making a “Pokédex” for iOS Using Create ML and Core ML with Vision”

While TensorFlow Lite is amazing, it has certain shortcomings that surface when you’re trying to run a model containing custom operations that aren’t supported by the framework.

Trying to load and run such a model often results in exceptions similar to the following :

As you can see, the model I was trying to load needed 3 operations (Normalize, ExtractFeatures, and Predict) that were missing from TensorFlow Lite’s default dependency.

Continue reading “Compiling a TensorFlow Lite Build with Custom Operations”

Many of your favorite mobile apps are currently using some form of neural networks and/or machine learning techniques to personalize your experience.

For example, Spotify and Apple Music, leaders in the music industry, use AI-powered recommendations for generating music suggestions.

Another shining example of the power of AI in apps is voice assistant tools such as Siri, Google Assistant, and Alexa. First, let’s define what mobile machine learning is and how it’s different than web-based ML.

Continue reading “5 Challenges for Developing Mobile Apps with AI & Machine Learning Capabilities”

The idea of being able to easily add powerful chatbots for improving user experience is appealing to React Native developers. A hybrid framework like React Native relies on tools that work cross-platform and reduce the mundane work of platform-dependent customizations and configurations.

Let’s talk about how you can bring the power of conversational AI to your React Native apps.

Continue reading “How to Make a Chatbot for your React Native App with Kommunicate”

In addition to good training data and the right model architecture, loss functions are one of the most important parts of training an accurate machine learning model.

For this post, I’d love to give developers an overview of some of the more advanced loss functions and how they can be used to improve the accuracy of models—or solve entirely new tasks.

For example, semantic segmentation models typically use a simple cross-categorical entropy loss function during training, but if we want to segment objects with many fine details like hair, adding a gradient loss function to the model can vastly improve results.

Continue reading “Research Guide: Advanced Loss Functions for Machine Learning Models”