Wouldn’t it be nice to be touched by an AR object?
You can react the AR object touched by your finger with Vision and Reality Kit.
First, get the position of your fingertip with Vision.
Perform a hit test at the acquired fingertip position and detect the AR object.
ARView can detect entities that are extensions of points on the View.
The entities detected by the hit test require a collision shape.
GitHub sample code: RealityKit-Sampler
About getting hand points: Hand Pose Detection with Vision Hand tracking: MLBoy Daisuke
How to handle RealityKit, such as how to create AR objects: RealityKit reference book
🐣
I’m a freelance engineer.
Feel free to contact us for work consultation 🐥
rockyshikoku@gmail.com
I am making an app that uses Core ML and ARKit.
We send machine learning / AR related information.
Thank you very much.
