artificial intelligence assistant uses face recognition and thermal scanning to screen for COVID-19 – Vision Systems Design
An artificial intelligence system originally designed to greet event attendees has evolved into a COVID-19 screening system that protects Canadas largest and most valuable collection of operational, historic military vehicles.
Master Cpl. Lana, an AI assistant developed by CloudConstable (Richmond Hill, Ontario, Canada; http://www.cloudconstable.com) utilizes an Intel (Santa Clara, CA, USA; http://www.intel.com) RealSense 415 3D depth camera and a FLIR (Wilsonville, OR, USA; http://www.flir.com) Lepton 2.5 thermal imaging module to greet volunteers at the Ontario Regiment Museum (Oshawa, Ontario, Canada; http://www.ontrmuseum.ca) and screen them for COVID-19 infection.
The museum originally intended to deploy the AI as a greeter at the museums front entrance, or to provide supplemental information at exhibits (Figure 1). The COVID-19 outbreak forced the museum to temporarily close for visitors, but volunteers still had to continue performing maintenance on the museums collection, however, and a second deployment of the technology was installed inside a vestibule located in the vehicle garage.
The systems hardware attaches to several brackets on a wall mount assembly using pieces of wall track. The Lepton 2.5 module, which connects to the platform using a USB2 cable, sits in a custom-fabricated housing placed above the screen. The RealSense 415 camera, which connects with the platform via USB3 cable, mounts to the same housing.
The housing attaches to a servomechanism designed with off-the-shelf parts that controls a pan/tilt mount. If the subjects face is not entirely within the cameras FOV, as determined by the systems face detection inference models, the software issues servo motion control commands in real time from the hardware platform via serial over USB API calls, to adjust the camera position until the subjects face is clearly visible An array with speaker and microphone sits below the screen.
Related: Artificial intelligence software expands capabilities of Boston Dynamics Spot robot
The company first experimented with using webcams for the system, but the cameras lacked depth sensing capability, according to Michael Pickering, President and CEO at CloudConstable. The system only interacts with users standing within approximately two yards of the screen. Doing so protects the privacy of anyone passing within the cameras FOV but not interacting with the system.
Other camera options evaluated include the Kinect Azure from Microsoft (Redmond, WA, US; http://www.microsoft.com), which had the advantage of a built-in microphone array, and several models of depth camera from ASUS (Beitou District, Taipei, Taiwan; http://www.asus.com). CloudConstable had difficulty finding any of these cameras readily available in Canada, however, and chose the RealSense camera.
Affordability drove the selection of the FLIR Lepton 2.5 module, capable of radiometric calibration with an acceptable resolution for the application, as well as the modules readily available API and SDK, says Pickering.
The AIs platform, an Intel NUC 9 Pro Kit, a PC with a 238 x 216 x 96 mm footprint, mounts behind the screen. The NUC 9 Pro includes an Intel Xeon E-2286M processor, 16 GBof DDR4-2666 memory, and an integrated UHD Graphics P630 GPU. CloudConstable chose the PC for its ability to also run a discrete GPU, in this case an ASUS Dual GeForce RTX 2070 MINI 8 GB GDDR6, to dedicate to graphics processing and ensure smooth, realistic animations. This allows inference processes to run strictly on the integrated GPU. The NUC 9 Pro also includes remote management software, allowing the company to provide off-site support.
Ambient light proves sufficient at most deployments of the AVA system, says Pickering. A simple LED light can provide extra illumination if required, such as inside the vestibule where museum volunteers go through their automated COVID-19 screening.
Volunteers stand in front of a high-definition ACER (San Jose, CA, USA; http://www.acer.com) display, on which Master Cpl. Lana appears (Figure 2). Pickering notes that the system supports multiple display types, however. The AI asks and the volunteer answers a set of COVID-19 screening questions, such as whether the volunteer is experiencing symptoms or has been exposed to anyone with the illness. The system then measures the volunteers skin temperature using the thermal imaging module.
If the volunteer correctly answers the screening questions and passes the temperature scan, they are checked in by the system and proceed into the museum for their shift. According to Jeremy Blowers, executive director of the Ontario Regiment Museum, the procedure takes less than 60 seconds to complete.
If the screening questions are not answered correctly or the temperature scan fails, the system sends an SMS message to managers phones informing them that a person in the facility has failed the COVID screening. The user does not learn that the screening failed, for fear of creating alarm. For example, a previous iteration of the system displayed on the monitor a live infrared image. Blowers asked CloudConstable to remove the image in case it showed elevated temperatures and upset the volunteer.
Related: Contactless temperature screening stations deployed in Chinese and Korean universities
In the case of a fail result, a human employee delivers a second set of screening questions. They also give the volunteer time to cool down, to account for artificially elevated skin temperatures after working outside on a hot day, for example. A second temperature scan with a hand device then takes place and management decides whether or not to allow the volunteer access to the building.
If volunteers want the system to recognize them, they must register with the software and allow to the system to learn what their face looks like. A video teaches volunteers how to work with the AI in order to allow her to recognize them, for instance by taking off their hats, eyeglasses, and/or masks during the registration process, says Blowers. Lana surprised museum staff by learning within two weeks how to recognize registered volunteers even if they had their masks on, Blowers adds
Once a volunteer registers, the AI greets them, informs them they are checked in, and thanks them for volunteering at the museum, all by name. Museum management receives compiled reports on check-in, check-out, and total volunteer hours on site.
AVAs development began in the fall of 2018 using the Intel distribution of OpenVINO toolkit, open source software designed to optimize deep learning models from pre-built frameworks and ease the deployment of inference engines onto Intel devices. CloudConstable used pre-trained convolutional neural network models for face detection and head pose detection that the company supplemented with a rules-based algorithm based on the inference results from the head pose model.
Because the AI only asks yes or no questions during the COVID-19 screening, Microsoft Azures speech-to-text API suits this and other AVA deployments, says Pickering. Head pose detection algorithms can also determine whether the volunteer nods or shakes their heads and translate the motion as a yes or no answer respectively.
All data generated by interacting with the volunteers, including the answers given to the screening questions and thermal scan results, stores on the Microsoft Azure cloud service.
No false negative cases in COVID-19 detection results exist to date, verified by a lack of reported cases among staff or their families, according to Blowers. False alarms have occurred, however, including two cases where volunteers were working outside in 42 C weather while wearing black hats, which elevated their skin temperature.
CloudConstable currently experiments with using the Intel RealSense 455 model for future AVA deployments. The camera has a wider FOV than the RealSense 415 and therefore presents less of a challenge for tall users. Both cameras use the same SDK such that the 455 can swap out with the 415 without any required software updates. The larger 455 model does require a larger mount than the 415 model, however.
See the original post:
artificial intelligence assistant uses face recognition and thermal scanning to screen for COVID-19 - Vision Systems Design
- Is Artificial Intelligence Worth the Investment? - Foreign Policy - September 19th, 2025 [September 19th, 2025]
- The Smartest Artificial Intelligence (AI) Stocks to Buy With $1,000 - Yahoo Finance - September 19th, 2025 [September 19th, 2025]
- Artificial Intelligence News for the Week of September 19; Updates from Druid AI, DxC Technology, G-P & More - solutionsreview.com - September 19th, 2025 [September 19th, 2025]
- Google and PayPal: The Artificial Intelligence (AI) Agent Revolution Is Here - The Motley Fool - September 19th, 2025 [September 19th, 2025]
- Video New book warns of threats to humanity from artificial intelligence - ABC News - Breaking News, Latest News and Videos - September 19th, 2025 [September 19th, 2025]
- Meet The Unstoppable Artificial Intelligence (AI) Stock That Has Jumped 112% in 6 Months. It Can Still Soar Higher. - Yahoo Finance - September 19th, 2025 [September 19th, 2025]
- When Artificial Intelligence Meets Jewish Wisdom - The Times of Israel - September 19th, 2025 [September 19th, 2025]
- How artificial intelligence is reshaping success in small businesses - Digital Journal - September 19th, 2025 [September 19th, 2025]
- 3 Popular Artificial Intelligence (AI) Stocks to Steer Clear Of. (Hint: One of Them Is Palantir) - The Motley Fool - September 19th, 2025 [September 19th, 2025]
- Mace Opens Hearing on the Future of Artificial Intelligence - House.gov - September 19th, 2025 [September 19th, 2025]
- Mustek Expands Into Artificial Intelligence With Majority Stake in Business AI - TechAfrica News - September 19th, 2025 [September 19th, 2025]
- Hearing Wrap Up: The U.S. Must Develop and Advance Artificial Intelligence to Dominate the Tech Race - House.gov - September 19th, 2025 [September 19th, 2025]
- The Role of Artificial Intelligence in Environment, Health, and Safety - Wolters Kluwer - September 19th, 2025 [September 19th, 2025]
- Artificial Intelligence - AI Update, September 19, 2025: AI News and Views From the Past Week - MarketingProfs - September 19th, 2025 [September 19th, 2025]
- Artificial Intelligence in the Bakken discussion - The Bismarck Tribune - September 19th, 2025 [September 19th, 2025]
- VERSABANK IMPLEMENTS NEW INTERNALLY DEVELOPED ARTIFICIAL INTELLIGENCE CAPABLITIES WITHIN CORE BANKING TECHNOLOGY - PR Newswire - September 19th, 2025 [September 19th, 2025]
- Evaluating the Diagnostic Accuracy of an Artificial Intelligence Tool for Pulmonary Abnormalities in Chest Radiographs: A Retrospective Study - Cureus - September 19th, 2025 [September 19th, 2025]
- AI is called artificial intelligence for a reason - The Charlotte News - September 19th, 2025 [September 19th, 2025]
- Artificial Intelligence Will Never Replace PsychiatryBut It Will Try to Destroy It - Psychiatric Times - September 19th, 2025 [September 19th, 2025]
- Europe Stereotactic Neuro-Navigation System Market Report 2025-2035 | Opportunities Fueled by Integration of Artificial Intelligence (AI) and Machine... - September 19th, 2025 [September 19th, 2025]
- Wide ranging experts envision future of artificial intelligence in Middlebury this week - Addison Independent - September 19th, 2025 [September 19th, 2025]
- 3D Bioprinting and Artificial Intelligence for Tumor Microenvironment Modeling: A Scoping Review of Models, Methods, and Integration Pathways - ACS... - September 19th, 2025 [September 19th, 2025]
- What's Behind Nvidia's Huge Artificial Intelligence (AI) Investment in the U.K.? - The Globe and Mail - September 19th, 2025 [September 19th, 2025]
- Prediction: This Artificial Intelligence (AI) Stock With a $455 Billion Revenue Pipeline Will Be Worth $3 Trillion in 5 Years - Nasdaq - September 19th, 2025 [September 19th, 2025]
- Medical Artificial Intelligence Advances with CPC-Bench, Evaluating LLMs on 7102 Cases and Achieving 67% Physician Validation - Quantum Zeitgeist - September 19th, 2025 [September 19th, 2025]
- Is Oracle a Good Artificial Intelligence Stock to Buy? - The Motley Fool - September 17th, 2025 [September 17th, 2025]
- 2 Top Artificial Intelligence (AI) Stocks to Buy With $1,000 Right Now - AOL.com - September 17th, 2025 [September 17th, 2025]
- Artificial Intelligence (AI) in Construction Strategic Intelligence Report 2025-2030: Rising Demand for Automation and Efficiency, Focus on... - September 17th, 2025 [September 17th, 2025]
- How AWS, The Ocean Cleanup, and artificial intelligence are finding ocean plastic - Amazon Sustainability - September 17th, 2025 [September 17th, 2025]
- The Artificial Intelligence Agenda from Capitol Hill to State Capitals: Where We Are and Where We Are (Probably) Going - Crowell & Moring LLP - September 17th, 2025 [September 17th, 2025]
- 2 Artificial Intelligence (AI) Leaders to Buy and Hold Forever - The Motley Fool - September 17th, 2025 [September 17th, 2025]
- Expert Analysis of Ethical Issues in Applying Artificial Intelligence to Cybersecurity - latesthackingnews.com - September 17th, 2025 [September 17th, 2025]
- Billionaire David Tepper of Appaloosa Is Buying 3 Trillion-Dollar Artificial Intelligence (AI) Stocks and Selling 3 Others - The Motley Fool - September 17th, 2025 [September 17th, 2025]
- Research on the influencing factors of generative artificial intelligence usage intent in post-secondary education: an empirical analysis based on the... - September 17th, 2025 [September 17th, 2025]
- Stony Brook University Receives $13.77M NSF Grant to Deploy a National Supercomputer to Democratize Access to Artificial Intelligence and Research... - September 17th, 2025 [September 17th, 2025]
- UK to be first college in KY to offer Artificial Intelligence as a major - LEX18 - September 17th, 2025 [September 17th, 2025]
- AI in classroom NC | Board of education considers policy for artificial intelligence in Wake County Public School district - ABC11 - September 17th, 2025 [September 17th, 2025]
- Remote Patient Monitoring and Artificial Intelligence - AJMC - September 17th, 2025 [September 17th, 2025]
- Ohio brings on artificial intelligence chatbot app to help fight crime, terrorism - The Statehouse News Bureau - September 17th, 2025 [September 17th, 2025]
- Prediction: Oracle Will Surpass Amazon, Microsoft, and Google to Become the Top Cloud for Artificial Intelligence (AI) By 2031 - The Motley Fool - September 17th, 2025 [September 17th, 2025]
- Artificial intelligence may begin impacting the price you pay to fly - NBC10 Philadelphia - September 17th, 2025 [September 17th, 2025]
- 2 Artificial Intelligence (AI) Leaders to Buy and Hold Forever - The Globe and Mail - September 17th, 2025 [September 17th, 2025]
- Understanding the Legal Hurdles of Artificial Intelligence: Questions to Ask and How to be Protected - Law.com - September 17th, 2025 [September 17th, 2025]
- Artificial Intelligence in Livestock Farming Market Current Scenario with Future Trends Analysis to 2034 - openPR.com - September 17th, 2025 [September 17th, 2025]
- 3 Top Artificial Intelligence (AI) Stocks to Buy and Hold Forever - The Motley Fool - September 17th, 2025 [September 17th, 2025]
- Should You Use Artificial Intelligence as Your Therapist? - US News Health - September 17th, 2025 [September 17th, 2025]
- Artificial Intelligence Chipset Market is on an Upward Growth Curve - openPR.com - September 17th, 2025 [September 17th, 2025]
- Prediction: This Artificial Intelligence (AI) Stock Will Be Worth $10 Trillion in 5 Years - The Motley Fool - September 15th, 2025 [September 15th, 2025]
- This Sci-Fi Box Office Hit About Artificial Intelligence Was Rejected By Denzel Washington - SlashFilm - September 15th, 2025 [September 15th, 2025]
- Congress and Artificial Intelligence | Interview: Adam Thierer - The Dispatch - September 15th, 2025 [September 15th, 2025]
- Protecting and empowering workers in an age of artificial intelligence Lessons from the Biden-Harris administration - Economic Policy Institute - September 15th, 2025 [September 15th, 2025]
- Remote monitoring and artificial intelligence in treating patients with heart failure - Medical Xpress - September 15th, 2025 [September 15th, 2025]
- Nvidia Has $4.3 Billion Invested in These 6 Artificial Intelligence (AI) Stocks. Here's the Best of the Bunch. - The Motley Fool - September 15th, 2025 [September 15th, 2025]
- Using Artificial Intelligence in the Search Process for Systematic Reviews - Pan American Health Organization (PAHO) - September 15th, 2025 [September 15th, 2025]
- Prediction: This Artificial Intelligence (AI) Stock Will Beat Opendoor Technologies over the Next 3 Years - The Motley Fool - September 15th, 2025 [September 15th, 2025]
- How artificial intelligence is impacting education - WZZM13.com - September 15th, 2025 [September 15th, 2025]
- 2 Artificial Intelligence (AI) Stocks That Could Become $1 Trillion Giants - The Motley Fool - September 15th, 2025 [September 15th, 2025]
- Prediction: This Artificial Intelligence (AI) Company Will Reshape Cloud Infrastructure by 2030 - Yahoo Finance - September 15th, 2025 [September 15th, 2025]
- Artificial intelligence in life sciences: The dawn of scientific AI - Scientific Computing World - September 15th, 2025 [September 15th, 2025]
- Prediction: This Artificial Intelligence (AI) Stock Will Beat Opendoor Technologies over the Next 3 Years - MSN - September 15th, 2025 [September 15th, 2025]
- Nvidia Has $4.3 Billion Invested in These 6 Artificial Intelligence (AI) Stocks. Here's the Best of the Bunch. - MSN - September 15th, 2025 [September 15th, 2025]
- Prediction: This Artificial Intelligence (AI) Company Will Reshape Cloud Infrastructure by 2030 - The Motley Fool - September 15th, 2025 [September 15th, 2025]
- US Airports Lead the Way in Smarter Security and Passenger Screening Through Artificial Intelligence: A Revolution in Air Travel Safety - Travel And... - September 15th, 2025 [September 15th, 2025]
- OpenAI commits $300 billion to Oracle in massive five-year deal to fuel artificial intelligence - TechRadar - September 15th, 2025 [September 15th, 2025]
- 2 Artificial Intelligence (AI) Stocks to Buy Before They Soar to $5 Trillion, According to a Wall Street Expert - Yahoo Finance - September 15th, 2025 [September 15th, 2025]
- 2 Artificial Intelligence (AI) Stocks That Could Become $1 Trillion Giants - Yahoo Finance - September 15th, 2025 [September 15th, 2025]
- The popularity of the anti-clanker meme suggests zoomers are finally getting tired of artificial intelligence - The Brock Press - September 15th, 2025 [September 15th, 2025]
- 3 Top Artificial Intelligence Stocks to Buy in September - MSN - September 15th, 2025 [September 15th, 2025]
- Prediction: This Artificial Intelligence (AI) Player Could Be the Next Palantir in the 2030s - The Motley Fool - September 13th, 2025 [September 13th, 2025]
- Four Jamaicans appointed to Caribbean Artificial Intelligence Task Force - Jamaica Observer - September 13th, 2025 [September 13th, 2025]
- Elon Musk Just Said 80% of Tesla's Value Will Come From This Artificial Intelligence (AI) Business, Which Jensen Huang Says Could Be Worth Trillions... - September 13th, 2025 [September 13th, 2025]
- Could This Artificial Intelligence (AI) Chipmaker's Stock Be the Best Bargain Right Now? - AOL.com - September 13th, 2025 [September 13th, 2025]
- 5 Top Artificial Intelligence Stocks to Buy in September - The Motley Fool - September 13th, 2025 [September 13th, 2025]
- Forget Everything You Think You Know About Artificial Intelligence - The Times of Israel - September 13th, 2025 [September 13th, 2025]
- How Artificial Intelligence Is Revolutionizing Workplace Ergonomics and Safety - Risk & Insurance - September 13th, 2025 [September 13th, 2025]
- Susan B. Anthony House to offer artificial intelligence ASL interpreting for guests - WXXI News - September 13th, 2025 [September 13th, 2025]
- Artificial Intelligence in Paediatric and Adolescent Fracture Detection: A Systematic Review and Meta-Analysis - Cureus - September 13th, 2025 [September 13th, 2025]
- The Guide #208: How theatre is holding its own in the age of artificial intelligence - The Guardian - September 13th, 2025 [September 13th, 2025]
- Prediction: This Unstoppable Artificial Intelligence (AI) Stock Will Be the World's First $10 Trillion Company by 2030 - Yahoo Finance - September 13th, 2025 [September 13th, 2025]
- Fact Check Team: The race to power artificial intelligence - KTUL - September 13th, 2025 [September 13th, 2025]