Implement Depth Estimation on iOS Using a FCRN Model

Articles
Computer Vision — iOS

Depth estimation is a major problem in computer vision, particularly for applications related to augmented reality, robotics, and even autonomous cars.

Traditional 3D sensors typically use stereoscopic vision, movement, or projection of structured light. However, these sensors depend on the environment (sun, texture) or require several peripherals (camera, projector), which leads to very bulky systems.

Continue reading “Implement Depth Estimation on iOS Using a FCRN Model”

Synthetic Data: A bridge over the data moat

Articles

If I gave you 30 minutes and a reasonably powerful computer, you could train a machine learning model to recognize dozens of breeds of dogs with higher accuracy than most humans.

This is partially due to great tools and frameworks like TensorFlow or PyTorch, but it’s also due to the availability of data. At some point, generous researchers decided to take the time to label a few thousand images of pets and release that data publicly.

Try to train a similar model for species of fish, and you’ll find yourself spending weeks or thousands of dollars sourcing and labeling data yourself.

Continue reading “Synthetic Data: A bridge over the data moat”

Big Data Analytics in Spark

Articles

2.5 quintillion bytes of data are produced every day. With that kind of data, new technologies are needed to analyze and perform analytics and machine learning.

Big data can’t ideally fit into the disk storage or even the memory of one computer, so, in such scenarios, you’d have to look at distributed computing. This involves spreading the processing of such data to multiple computers.

Continue reading “Big Data Analytics in Spark”

Creating an Animated 3D Phoenix Lens in Lens Studio

Articles
Introduction

In this post, I’ll explore how I made a Lens that features an animated phoenix flying through an AR scene anchored to the ground. This is the finished Lens:

To get there, we will leverage the Refinement Pack and Particles template from Lens Studio, as well as a 3D phoenix asset from Sketchfab.

Specifically, this post will cover:

Moving an object along a 3D path through the scene using a Prefab from the Refinement Pack Applying a texture to a 3D model of a phoenix downloaded from Sketchfab Working with particle emitters to add a stationary column of smoke, embers throughout the scene, and a bokeh effect that follows the phoenix

Let’s dive in!

Continue reading “Creating an Animated 3D Phoenix Lens in Lens Studio”

Equality, Identity, and Hashing with Swift Types

Articles

Before we begin, let’s get started by answering the following question:

What is a type?

The answer to this question is fairly simple—a type is a collection of related data that encapsulates certain concepts and principles. A type can be abstract or concrete, it defines a set of valid operations that we can perform on it, and finally, a type clearly demarcates the internal and external.

Continue reading “Equality, Identity, and Hashing with Swift Types”

Add a Hand Tracker and 3D Object in Facebook’s Spark AR Studio

Articles

Gesture recognition helps us to know the meaning of human body movement, including the movement of hands, head, arms, face, or body. Today’s world is observing huge advances in visualization displays and this includes object trackers in AR applications.

The main purpose of this article is to explore gesture recognition in Facebook’s Spark AR Studio for an efficient human-computer interaction. It presents a method for tracking hand gestures and recognizing hand gestures by extracting unique invariant features from gestures.

Continue reading “Add a Hand Tracker and 3D Object in Facebook’s Spark AR Studio”

Snapchat Lens Creator Spotlight: Jonah Cohn

Articles Interviews

Jonah Cohn doesn’t think Snapchat is going anywhere. One of the his so called “forever apps,” Snapchat has been part of the student’s life since 2013. Cohn must have found an endless supply of coffee because he’s not only a student, but a prodigious lens creator who’s active online in many digital creative circles.

I’d be tired making just one lens every few months, but he seems to churn them out one after the other — each one better than the last! Thankfully, Cohn had time to answer a few questions about his work so that we could learn more.

Continue reading “Snapchat Lens Creator Spotlight: Jonah Cohn”

Building a “Motivation Bot” with TensorFlow.js, Face Detection, and Emotion Classification

Articles

As much as our physical well-being is important, our mental well-being is essential as well. Many of us don’t really give as much priority to the mental health of ourselves and others. But mental health is a serious issue in today’s world, as many suffer in myriad ways.

Hence, motivation is very necessary. Positive thoughts and surroundings, while not a catch-all, can be one part of helping improve one’s mental perspective.

Continue reading “Building a “Motivation Bot” with TensorFlow.js, Face Detection, and Emotion Classification”