Measure Your Space 2.0
Play the movies 🙂
- App Architecture.
- Scanning-related UI and custom-guided experience.
- Device-related detection during scanning, such as camera movement speed detection.
- Research into RoomPlan and RealityKit for a better scanning experience.
- CI/CD setup. GitHub workflow for automated build and deployment to TestFlight.
- Data model design.
- Data management for local device storage, backend service communication, and sync mechanism.
- Scenekit implementation. Implemented a scene construction during the scanning experience that mimicked the RoomPlan experience but with full customization. This also included a dollhouse and a custom 2D/3D preview.
- Integration to the Lowe’s Consumer App.
- Converting the app into the Swift Package version.
- Implemented lightweight custom network client for communication to the backend services using REST API.
- Tap into a secure network client built into the Lowe’s Consumer App.
Anti-Theft Pilot Program with DeWALT
- With the success of the POC, the Pilot was created to expand the program to 10 stores and 1000 tools.
- This pilot had more ambitious asks. One main thing is being tightly integrated into the POS system.
- I started the project and developed a design that used Raspberry PI (IoT) instead of an Android app.
- The Raspberry PIs were used to contain the Bluetooth module written in Python to find the tools and perform locking and unlocking. I was mainly in charge of this Bluetooth module.
- The Raspberry PIs were also connected to the backend services, which worked closely with the POS system. This allowed the Raspberry PIs to be the middle entity that would know what was happening in the workflow.
- This allowed tight integration into the POS system so that the Bluetooth unlocking of the tools would happen immediately after a successful transaction.
- This was a big win for the Labs since this project was the first project ever in Lowe’s history to deploy 10 IoT devices in 10 stores. This meant our team had to prepare a smart workflow to make sure that the Raspberry PIs were stable and also come up with a system for early fault detection.
Anti-Theft POC with DeWALT
- Built an Android App to use Bluetooth technology to Lock/Unlock Dewalt tools.
- Collaborated with the Dewalt hardware team to design the unlock mechanism.
- Collaborated with the Dewalt hardware team to identify the tools to unlock by adding the tool’s unique serial number to the Bluetooth signal.
- The tool will be initially in a locked state and be unlocked using the android app after payment.
- The stolen tool will be locked and unusable.
- This was tested in one store and with 100 test tools.
LowesAR – AR viewer for Android
- Led a project for creating an AR viewer for the Android Lowe’s Consumer App. Implemented in Unity and integrated into the Lowe’s Consumer App as a plugin.
- Used the information received from the product detail page to download the assets for CORGIS.
- Great visuals and user interaction.
- The app was exported as IL2CPP 64-bit based code, compiled and built in Android Studio, and added to the Lowe’s Consumer App codebase.
Store map POC for iOS
- A POC to add store map functionality to the Lowe’s Consumer App.
- Post-processed the JSON and the SVG to create a new SVG file with layers of information such as aisle number and departments.
- Created a JSON file allowing location lookup on the new SVG file using aisle and bay. Essentially, a product lookup.
- This new layout SVG file was used as input data to the iOS POC to convert into a PDF with the product location information (aisle & bay).
- The iOS POC app was created and handed off to a team in charge of the store maps.
USDZ conversion pipeline for CORGIS 3.0
CORGIS 2.0 transformed from .NET to Node-based service. In order to support this new service, the USDZ conversion service also needed to change. USDZ conversion is now a service running on docker using the same Pixar USD SDK and Google’s USD SDK to covert GLB assets into USDZ during asset creation.
USDZ conversion plugin for CORGIS 2.0
CORGIS is a photogrammetry-based 3D scan service that provides GLB and GLTF assets to Lowe’s. Pixar’s USD SDK was built, and C# binding was created. The binding allowed Pixar’s USD SDK to be used as a plugin in the CORGIS .NET environment. This effort was to create a runtime conversion of GLB to USDZ.\
View In Your Space iOS Update.
Update to add alignment metadata to the USDZ assets in the 3D asset service. Created an internal app to assist with the initial metadata changes. This tool was later adapted to a web app in the asset service.
View In Your Space iOS.
AR product viewer in the iOS Lowe’s Consumer App. Written in Swift and using ARKit. Created the proof of concept app to be integrated with the Lowe’s Consumer app.
Lowes Vision Pro
iOS app designed to capture design elements for the Kitchen Design specialist. This project was created in Unity, targeting iPad.