Touching AR [Computer Vision * AR]

Wouldn’t it be nice to be touched by an AR object?

Touching AR

You can react the AR object touched by your finger with Vision and Reality Kit.

First, get the position of your fingertip with Vision.

Perform a hit test at the acquired fingertip position and detect the AR object.
ARView can detect entities that are extensions of points on the View.

The entities detected by the hit test require a collision shape.

GitHub sample code: RealityKit-Sampler

About getting hand points: Hand Pose Detection with Vision Hand tracking: MLBoy Daisuke

How to handle RealityKit, such as how to create AR objects: RealityKit reference book


I’m a freelance engineer.
Feel free to contact us for work consultation 🐥

I am making an app that uses Core ML and ARKit.
We send machine learning / AR related information.


Thank you very much.



Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store