AR driven try-on for online shopping applications

April 20, 2021

Share on facebook
Share on twitter

Shopping is not as pleasant as it has been before the pandemic. Queuing up in front of the stores because only a limited amount of people is allowed inside, wearing a mask all the time and disinfecting hands at every store one enters are only a few of the measures taken into action in order to ensure public health, not to talk about distance regulations…

The amount of online shoppers has grown tremendously in the past decades with the rise of the internet, famous online retailers and global trade distribution hubs. And with the pandemic raging there have barely been alternative options lately. One disadvantage of online shopping has always been that the huge amount of returns due to the lack of opportunity to try on the products. This is not only a huge point in customer satisfaction but also a tremendous burden for the environment.

Some applications make it possible now to try on items virtually and thus enhance the online shopping and decision making experience for online shopping. Augmented reality is a key tool in this approach. We have accompanied a 3D professional in the transition from photogrammetry to 3D scanning for virtual data display. Let´s embark together on this journey!

AR-sneakers

The sportswear and sneakers label Rockdeep offers fashionable apparel and shoes. The colorful designs add a unique trendy and athletic touch to every outfit, no matter if for sports or just casual everyday life. Rockdeep wants to enhance their customer´s online shopping experience by implementing Augmented Reality enabling 3D display and online try-on on their website via smartphone.

Rockdeep hired the experienced 3D artist Logan Hamilton Davis to complete the job. Logan focuses on games, visualizations, and interactive media. He has worked on 3D models for Yahoo News, DC Comics, and various marketing and video game companies. Lately, he focused on photogrammetry cleanup and interactive product models.

Having a tough time creating the 3D models by means of photogrammetry, Logan looked for faster and more efficient options to create nice 3D files for his customer Rockdeep.

“I attempted to use photogrammetry to capture shoes for ROCKDEEP and had only slight success. The detail that I was able to capture with my setup would not provide the fidelity needed for customers on the ROCKDEEP store website.  My photogrammetry scans created noisy 3D models with bumps where it should have been smooth and so the detail was useless for transferring to lower polygon models. It was also substantially time intensive to take all the photos needed and process the images with the photogrammetry software. In my research on how to improve this, I came across Shining3d and their incredible scanners.”

-Logan Hamilton Davis, Professional 3D Artist

3D scanning : a smooth and simple approach to clean, colorful and high-quality 3D models

For the online AR display Logan needs to create digital models of Rockdeep´s colorful sneakers. In order to create the working process as smooth and efficient as possible, he opted for the EinScan Pro HD with the Industrial Pack. Additionally he used the Color Pack to be able to capture the colorful designs of the Rockdeep shoes.

Image 1: The Rockdeep “Mother Africa” shoe needs to be displayed in AR on Rockdeep´s website

1. Scanning the Shoe

Image 2: Logan´s scanning setup with the EinScan Pro HD, Color Pack, Industrial Pack and the “Mother Africa” shoe

2. Software Processing

Image 3: the final scanning data of the shoe…

Image 4: …looks colorful and accurate

Image 5: …from every angle

“I was very impressed by the capabilities of the Einscan Pro HD. The software guided me through the whole process and worked without any issues. I scanned the shoe by features and rotated it on the turntable to capture all areas of the shoe. The software stitched those separate scans together into a seamless whole.”

-Logan Hamilton Davis, Professional 3D Artist

3. Processing of Scanning Data

Image 6: Thanks to the open output file formats of the EinScan Pro HD, the scanning data can be imported…

Image 7: …into a broad range of different data processing software. Logan used Blender to further work on his 3D scans.

“The model will eventually be used on the ROCKDEEP website to allow customers to inspect all areas of the shoe. It will also be used to create a design customizer to enable people to choose materials for each individual part of the shoe and speed up design iteration.”

-Logan Hamilton Davis, Professional 3D Artist

Image 8 : Final 3D model created from the scan with the EinScan Pro HD

“I was impressed by the range of applications (from art to industrial) and different scanning processes (fixed vs. freehand). The industrial and color packs added all the extra features I needed. The total price was within budget and significantly more approachable than other competitors. I was floored by the detail captured and the ease of use. It just works and works phenomenally.“

-Logan Hamilton Davis, Professional 3D Artist