Blog

Machine learning unlocks a wide range of possibilities when it comes to AR development—nobody has proved that more than Snapchat, whose immersive augmented reality Lenses work so well in large part because of the ML models running underneath them (things like face tracking, background segmentation, and more).

With SnapML, though, Snapchat has opened up this expansive capability to its community of Lens Creators, allowing them to implement custom machine learning models in their Lenses.

Continue reading “Demystifying common use cases for SnapML in Lens Studio”

Lens Studio’s functionalities can be extended by writing your own custom code in JavaScript. For instance, you can write your own code to target various events in your Lens and trigger specific actions.

Lens Studio is already powerful without custom code, but the ability to bring your own code to the platform is just amazing. Without further ado, let’s jump straight in and see how this can be done.

Continue reading “Custom Scripting in Lens Studio”

Privacy has always been a hot-button topic of discussion when it comes to the age-old debate of iOS vs Android.

While I’m not going to pick a side here, Android has made some radical changes in recent years concerning privacy, and the overhaul of the permission handling system is probably the biggest one of those changes.

Continue reading “Handling Permissions in Android”

Below is the transcript for the above video explaining the step-by-step process of downloading Fritz AI pre-trained models and opening them in Lens Studio.

“Hey everyone, my name is Emilie and I’m the content manager for Heartbeat here at Fritz AI. Today I’m going to show you just how easy it is to create a Lens Studio profile and open one of our many pre-trained SnapML models.

Continue reading “How to Load Fritz AI’s Pre-Trained Models into Lens Studio”

Follow along as we build a custom, ML-powered face mask color changing Snapchat Lens.

You’ll learn how to use Fritz AI Studio to:

Continue reading “Custom Face Mask Segmentation for Lens Studio with Fritz AI (Video + Transcript)”

We’re committed to making it easier to work with machine learning across mobile platforms. That’s why we’re happy to share that we’ve created a number of pre-trained SnapML project templates that are ready-to-use in Lens Studio upon download.

This means that Snapchat Lens Creators working with Fritz AI now have an even easier way to get started with machine learning in their projects. Just download the project zip file, open the Lens Studio Project, and let your imagination run free. That’s it!

Continue reading “Introducing Fritz AI Pre-trained Projects for SnapML in Lens Studio”

While machine learning might seem fun and exciting from the outside, building a dataset and training the model is as dull as it gets.

However, don’t take this the wrong way—model training is a very critical part of the entire process and shouldn’t be overlooked.

Continue reading “Training a TensorFlow Lite Image Classification model using AutoML Vision Edge”

SnapML provides a way to utilize machine learning to build more immersive Snapchat AR Lenses. Style transfer is a computer vision technology that allows creators and developers to transfer any design from one source image to any targeted image.

Once our style transfer model is ready, we’ll upload and configure the converted ONNX/PB model file in Lens Studio, and from there, upload the resulting to our personal Snapchat app. And, then we can make it public so that others can use our lens.

Continue reading “Create a Style Transfer Snapchat Lens with SnapML’s ML Component”

Fritz AI allows developers to use mobile-optimized machine learning (ML) algorithms to create custom ML models (without code) for use in their apps.

In this article, we’ll walk you through the process of creating an image labeling ML model that can identify different car logos, and then integrating the model into an iOS app.

Continue reading “Implementing a Fritz AI Machine Learning Model in an iOS app”