github.com/google-ai-edge/mediapipe @v0.10.35

layout: forward target: https://developers.google.com/mediapipe title: Home nav_order: 1

Attention: We have moved to https://developers.google.com/mediapipe as the primary developer documentation site for MediaPipe as of April 3, 2023.

Attention: MediaPipe Solutions Preview is an early release. Learn more.

On-device machine learning for everyone

Delight your customers with innovative machine learning features. MediaPipe contains everything that you need to customize and deploy to mobile (Android, iOS), web, desktop, edge devices, and IoT, effortlessly.

• See demos
• Learn more

Get started

You can get started with MediaPipe Solutions by by checking out any of the developer guides for vision, text, and audio tasks. If you need help setting up a development environment for use with MediaPipe Tasks, check out the setup guides for Android, web apps, and Python.

Solutions

MediaPipe Solutions provides a suite of libraries and tools for you to quickly apply artificial intelligence (AI) and machine learning (ML) techniques in your applications. You can plug these solutions into your applications immediately, customize them to your needs, and use them across multiple development platforms. MediaPipe Solutions is part of the MediaPipe open source project, so you can further customize the solutions code to meet your application needs.

These libraries and resources provide the core functionality for each MediaPipe Solution:

• MediaPipe Tasks: Cross-platform APIs and libraries for deploying solutions. Learn more.
• MediaPipe models: Pre-trained, ready-to-run models for use with each solution.

These tools let you customize and evaluate solutions:

• MediaPipe Model Maker: Customize models for solutions with your data. Learn more.
• MediaPipe Studio: Visualize, evaluate, and benchmark solutions in your browser. Learn more.

Legacy solutions

We have ended support for these MediaPipe Legacy Solutions as of March 1, 2023. All other MediaPipe Legacy Solutions will be upgraded to a new MediaPipe Solution. See the Solutions guide for details. The code repository and prebuilt binaries for all MediaPipe Legacy Solutions will continue to be provided on an as-is basis.

For more on the legacy solutions, see the documentation.

Framework

To start using MediaPipe Framework, install MediaPipe Framework and start building example applications in C++, Android, and iOS.

MediaPipe Framework is the low-level component used to build efficient on-device machine learning pipelines, similar to the premade MediaPipe Solutions.

Before using MediaPipe Framework, familiarize yourself with the following key Framework concepts:

• Packets
• Graphs
• Calculators

Community

• Slack community for MediaPipe users.
• Discuss - General community discussion around MediaPipe.
• Awesome MediaPipe - A curated list of awesome MediaPipe related frameworks, libraries and software.

Contributing

We welcome contributions. Please follow these guidelines.

We use GitHub issues for tracking requests and bugs. Please post questions to the MediaPipe Stack Overflow with a mediapipe tag.

Resources

Publications

• Bringing artworks to life with AR in Google Developers Blog
• Prosthesis control via Mirru App using MediaPipe hand tracking in Google Developers Blog
• SignAll SDK: Sign language interface using MediaPipe is now available for developers in Google Developers Blog
• MediaPipe Holistic - Simultaneous Face, Hand and Pose Prediction, on Device in Google AI Blog
• Background Features in Google Meet, Powered by Web ML in Google AI Blog
• MediaPipe 3D Face Transform in Google Developers Blog
• Instant Motion Tracking With MediaPipe in Google Developers Blog
• BlazePose - On-device Real-time Body Pose Tracking in Google AI Blog
• MediaPipe Iris: Real-time Eye Tracking and Depth Estimation in Google AI Blog
• MediaPipe KNIFT: Template-based feature matching in Google Developers Blog
• Alfred Camera: Smart camera features using MediaPipe in Google Developers Blog
• Real-Time 3D Object Detection on Mobile Devices with MediaPipe in Google AI Blog
• AutoFlip: An Open Source Framework for Intelligent Video Reframing in Google AI Blog
• MediaPipe on the Web in Google Developers Blog
• Object Detection and Tracking using MediaPipe in Google Developers Blog
• On-Device, Real-Time Hand Tracking with MediaPipe in Google AI Blog
• MediaPipe: A Framework for Building Perception Pipelines

Videos

• YouTube Channel