Category: Articles

Among the new capabilities in Lens Studio 3.4, one that might have flown a bit under the radar—especially with the really impressive 3D Body Tracking, Full-Body Segmentation, and enhanced Finger Tracking taking a lot of the spotlight—is the new Asset Library.

Put simply, it’s a new collection of ready-to-use assets, provided by the Snap team and by a few select Official Lens Creators. If you want to get started with a range of different capabilities inside Lens Studio, but don’t want to go elsewhere to build 3D objects, ML models, materials, and more, this new library is where you should start.

Continue reading “Experimenting with Lens Studio’s Asset Library”

This blog is a continuation of our series comparing on-device OCR libraries. Here’s a similar comparison on iOS devices.

Summarizing the results of our comparison on iOS devices, Firebase’s ML Kit was leading by a solid margin against Tesseract OCR. However, outcomes weren’t very similar on Android phones. For this particular test, we used Samsung Galaxy J7 with 2GB RAM and 32GB Memory. Different hardware may result in different results.

Continue reading “Choose the Right On-Device Text Recognition (OCR) SDK on Android Using DeltaML”

A month back I wrote a post that introduced an open-source package react-native-text-detector. In that tutorial, we built a simple Business Card app using the same package. Package used different libraries for detection on Android and iOS. It used Firebase’s ML Kit on Android and Tesseract OCR along with Core ML on iOS. The major reason for this is mentioned here.

Since the conflict between ML Kit and React Native on iOS was resolved, we now have to select one proper solution for achieving this task on both platforms. In order to make an informed decision, we had to analyze the performance of both of these libraries on both platforms.

Continue reading “Comparing iOS Text Recognition SDKs Using Delta”

Editor’s Note: For an in-depth look at SnapML, Lens Studio’s new framework for leveraging custom machine learning models inside Snapchat Lenses, download our free comprehensive guide.

OLC Kaden (guccikaden) is well on his way to 100k subscribers on Snapchat. The young creator tends toward vintage-inspired lenses that make this Millennial yearn for the days of Lisa Frank stickers and Y2K. With so many fun, aesthetic Lenses, it’s no surprise Kaden is making waves in the Lens creation world. I had a quick chat with the Lens maker to learn more.

Continue reading Snapchat Lens Creator Spotlight: Kaden

In a previous tutorial, I walked through how to train a style transfer model with Fritz AI and implement it inside Lens Studio to create a custom artistic Snapchat Lens:

While this was a really cool first step, it left me itching to push things just a bit further. Specifically, I wondered what it would take to manipulate where in the camera scene the style transfer model is actually applied. For instance, could I apply the artistic style only to the background and not the human subject, creating a semi-virtual background?

Continue reading “Combining Style Transfer with Background Replacement in Lens Studio with Fritz AI and SnapML”

Facebook’s AR Studio is used for building augmented reality experiences targeted at the Facebook and Instagram platforms.

In this tutorial, let’s look at how you can use this software to build an effect that responds to someone’s face. To achieve this you will take advantage of AR Studio’s Face Tracker, Face Mesh, and Texture.

Continue reading How to Create a Face Tracking Effect in Facebook’s AR Studio

AR camera filters that can be accessed via social media apps like Facebook and Instagram are referred to as “social” applications. Inside the camera feature of these applications, there are a variety of amusing and attractive filters. Facebook and Instagram both have AR capabilities.

Spark AR Studio can be used to modify the appearance of people’s faces. You may also give the face and the whole scene a finishing touch. You will learn how to do some minor face smoothing and lighting effects in this blog.

Continue reading “Face Changing Effect In Spark AR”

NLP is a hot topic right now in the deep learning and machine learning communities, thanks to the incredible development of Transformer-based neural networks like BERT and GPT-2.

Natural language processing (NLP) gives programs and applications the ability to understand spoken and written human language.

Developing NLP applications is difficult because traditionally, computers are designed for humans to interact with them in precise, unambiguous, and highly-structured programming languages, or by using a limited number of set spoken commands.

Continue reading “Sentiment Analysis iOS Application Using Hugging Face’s Transformers Library”

It’s seems that, in the last decade, people increasingly have turned to social networks to express their opinions on everything from everyday life to politics and even businesses. This has been an important source — for businesses — to probe the market and get a clear picture of the needs and directions that influence it.

For me, the social media that seems the most active in the area of expressing opinions is probably Twitter.

Continue reading “Processing Tweets Using Natural Language and Create ML on iOS”