Detecting Skin Cancer on iOS with Xcode and Create ML

Articles

Machine learning (ML) began its ascent into the medical industry when it acquired the ability to detect visual patterns between images—a skill doctors and technicians take years to master.

Specifically, ML models for computer vision tasks in the medical field train on datasets of separated images to learn to recognize their similarities and differences.

Continue reading “Detecting Skin Cancer on iOS with Xcode and Create ML”

Real-Time 2D/3D Feature Point Extraction from a Mobile Camera

Articles

If you got past the jargon of the title, you probably have at least a passing interest in computer vision. However, fear not! This is going to be a fairly gentle walk-through of some of my projects at the intersection of Machine Learning and Augmented Reality.

They all share a common denominator: feature point extraction. InstaSaber, Say BARK!, and the puppet videos you see below are a few examples.

Continue reading “Real-Time 2D/3D Feature Point Extraction from a Mobile Camera”

Live Conversation Updates for New Messages in an Android Chat Application

Articles

Throughout the Android chat app development series, we’ve built an app that allows users to register, send/receive text messages, open conversations, and receive notifications for incoming messages.

One additional essential feature for chat apps is the ability to update the active, live conversation. Once a new message arrives for the currently active conversation, it should be updated to reflect the new changes (either sent/received messages).

Continue reading “Live Conversation Updates for New Messages in an Android Chat Application”

Comparing Mobile Machine Learning Frameworks

Articles

In the past few years we’ve seen many startups and even mature companies coming up with new mobile apps or features powered by machine learning and AI. These features require some heavy, real-time processing by neural networks.

The potential killers of these ML-powered experiences? Data roundtrips for inference, the cost of backend servers to support millions of devices, concerns surrounding user data privacy.

Continue reading “Comparing Mobile Machine Learning Frameworks”

How next-gen AI accelerators will transform mobile machine learning

Articles
Introduction

In recent years, AI and (more specifically) machine learning have become so popular that the hype surrounding them has become contagious.

It’s becoming apparent that the widespread use of deep learning doesn’t stop at just computer scientists and programmers but has made its way into every domain, ranging from physics, biology, and chemistry to healthcare, transportation, and finance.

Continue reading “How next-gen AI accelerators will transform mobile machine learning”

Advanced Tips for Core ML

Articles

Core ML is the most popular and powerful framework for adding machine learning and AI to iOS apps. High-level APIs provided by tools like Turi Create and Create ML make it possible to train mobile-friendly models without ML expertise.

But as projects grow in scale and complexity, it’s often necessary to dive deeper into the capabilities of Core ML to deliver the best user experiences possible.

Continue reading “Advanced Tips for Core ML”