Blog

Developers using Fritz AI can now track the body positions of people in images and video with Pose Estimation.

Continue reading “Pose Estimation on Android”

Deploying machine learning-based Android apps is gaining prominence and momentum with frameworks like TensorFlow Lite, and there are quite a few articles that describe how to develop mobile apps for computer vision tasks like text classification and image classification.

But there’s very much less that exists about working with audio-based ML tasks in mobile apps, and this blog is meant to address that gap — specifically, I’ll describe the steps and code required to perform audio classification in Android apps.

Continue reading “Audio Classification in an Android App with TensorFlow Lite”

Google’s Colab is a truly innovative product for machine learning. It enables machine engineers to run Notebooks and easily share them with colleagues. Another key advantage is access to GPUs and TPUs.

In this piece, we’ll highlight some of the tips and tricks mentioned during this year’s TF summit. Specifically, these tips will help you in getting the best out of Google’s Colab.

Continue reading “Top 10 Tricks for TensorFlow and Google Colab Users”

In the last piece in this series on developing with Flutter, we looked at how we can implement text recognition using ML Kit, which belongs to the Firebase family.

In this sixth installment of the series, we’ll keep working with ML Kit, this time focusing on implementing image labeling. The application we build will be able to label the contents of an image and provide a confidence level.

Continue reading “Image Labeling in Flutter Using Firebase’s ML Kit”

Among the new capabilities in Lens Studio 3.4, one that might have flown a bit under the radar—especially with the really impressive 3D Body Tracking, Full-Body Segmentation, and enhanced Finger Tracking taking a lot of the spotlight—is the new Asset Library.

Put simply, it’s a new collection of ready-to-use assets, provided by the Snap team and by a few select Official Lens Creators. If you want to get started with a range of different capabilities inside Lens Studio, but don’t want to go elsewhere to build 3D objects, ML models, materials, and more, this new library is where you should start.

Continue reading “Experimenting with Lens Studio’s Asset Library”

This blog is a continuation of our series comparing on-device OCR libraries. Here’s a similar comparison on iOS devices.

Summarizing the results of our comparison on iOS devices, Firebase’s ML Kit was leading by a solid margin against Tesseract OCR. However, outcomes weren’t very similar on Android phones. For this particular test, we used Samsung Galaxy J7 with 2GB RAM and 32GB Memory. Different hardware may result in different results.

Continue reading “Choose the Right On-Device Text Recognition (OCR) SDK on Android Using DeltaML”

A month back I wrote a post that introduced an open-source package react-native-text-detector. In that tutorial, we built a simple Business Card app using the same package. Package used different libraries for detection on Android and iOS. It used Firebase’s ML Kit on Android and Tesseract OCR along with Core ML on iOS. The major reason for this is mentioned here.

Since the conflict between ML Kit and React Native on iOS was resolved, we now have to select one proper solution for achieving this task on both platforms. In order to make an informed decision, we had to analyze the performance of both of these libraries on both platforms.

Continue reading “Comparing iOS Text Recognition SDKs Using Delta”

Editor’s Note: For an in-depth look at SnapML, Lens Studio’s new framework for leveraging custom machine learning models inside Snapchat Lenses, download our free comprehensive guide.

OLC Kaden (guccikaden) is well on his way to 100k subscribers on Snapchat. The young creator tends toward vintage-inspired lenses that make this Millennial yearn for the days of Lisa Frank stickers and Y2K. With so many fun, aesthetic Lenses, it’s no surprise Kaden is making waves in the Lens creation world. I had a quick chat with the Lens maker to learn more.

Continue reading Snapchat Lens Creator Spotlight: Kaden

In a previous tutorial, I walked through how to train a style transfer model with Fritz AI and implement it inside Lens Studio to create a custom artistic Snapchat Lens:

While this was a really cool first step, it left me itching to push things just a bit further. Specifically, I wondered what it would take to manipulate where in the camera scene the style transfer model is actually applied. For instance, could I apply the artistic style only to the background and not the human subject, creating a semi-virtual background?

Continue reading “Combining Style Transfer with Background Replacement in Lens Studio with Fritz AI and SnapML”