artificial intelligence assistant uses face recognition and thermal scanning to screen for COVID-19 – Vision Systems Design
An artificial intelligence system originally designed to greet event attendees has evolved into a COVID-19 screening system that protects Canadas largest and most valuable collection of operational, historic military vehicles.
Master Cpl. Lana, an AI assistant developed by CloudConstable (Richmond Hill, Ontario, Canada; http://www.cloudconstable.com) utilizes an Intel (Santa Clara, CA, USA; http://www.intel.com) RealSense 415 3D depth camera and a FLIR (Wilsonville, OR, USA; http://www.flir.com) Lepton 2.5 thermal imaging module to greet volunteers at the Ontario Regiment Museum (Oshawa, Ontario, Canada; http://www.ontrmuseum.ca) and screen them for COVID-19 infection.
The museum originally intended to deploy the AI as a greeter at the museums front entrance, or to provide supplemental information at exhibits (Figure 1). The COVID-19 outbreak forced the museum to temporarily close for visitors, but volunteers still had to continue performing maintenance on the museums collection, however, and a second deployment of the technology was installed inside a vestibule located in the vehicle garage.
The systems hardware attaches to several brackets on a wall mount assembly using pieces of wall track. The Lepton 2.5 module, which connects to the platform using a USB2 cable, sits in a custom-fabricated housing placed above the screen. The RealSense 415 camera, which connects with the platform via USB3 cable, mounts to the same housing.
The housing attaches to a servomechanism designed with off-the-shelf parts that controls a pan/tilt mount. If the subjects face is not entirely within the cameras FOV, as determined by the systems face detection inference models, the software issues servo motion control commands in real time from the hardware platform via serial over USB API calls, to adjust the camera position until the subjects face is clearly visible An array with speaker and microphone sits below the screen.
Related: Artificial intelligence software expands capabilities of Boston Dynamics Spot robot
The company first experimented with using webcams for the system, but the cameras lacked depth sensing capability, according to Michael Pickering, President and CEO at CloudConstable. The system only interacts with users standing within approximately two yards of the screen. Doing so protects the privacy of anyone passing within the cameras FOV but not interacting with the system.
Other camera options evaluated include the Kinect Azure from Microsoft (Redmond, WA, US; http://www.microsoft.com), which had the advantage of a built-in microphone array, and several models of depth camera from ASUS (Beitou District, Taipei, Taiwan; http://www.asus.com). CloudConstable had difficulty finding any of these cameras readily available in Canada, however, and chose the RealSense camera.
Affordability drove the selection of the FLIR Lepton 2.5 module, capable of radiometric calibration with an acceptable resolution for the application, as well as the modules readily available API and SDK, says Pickering.
The AIs platform, an Intel NUC 9 Pro Kit, a PC with a 238 x 216 x 96 mm footprint, mounts behind the screen. The NUC 9 Pro includes an Intel Xeon E-2286M processor, 16 GBof DDR4-2666 memory, and an integrated UHD Graphics P630 GPU. CloudConstable chose the PC for its ability to also run a discrete GPU, in this case an ASUS Dual GeForce RTX 2070 MINI 8 GB GDDR6, to dedicate to graphics processing and ensure smooth, realistic animations. This allows inference processes to run strictly on the integrated GPU. The NUC 9 Pro also includes remote management software, allowing the company to provide off-site support.
Ambient light proves sufficient at most deployments of the AVA system, says Pickering. A simple LED light can provide extra illumination if required, such as inside the vestibule where museum volunteers go through their automated COVID-19 screening.
Volunteers stand in front of a high-definition ACER (San Jose, CA, USA; http://www.acer.com) display, on which Master Cpl. Lana appears (Figure 2). Pickering notes that the system supports multiple display types, however. The AI asks and the volunteer answers a set of COVID-19 screening questions, such as whether the volunteer is experiencing symptoms or has been exposed to anyone with the illness. The system then measures the volunteers skin temperature using the thermal imaging module.
If the volunteer correctly answers the screening questions and passes the temperature scan, they are checked in by the system and proceed into the museum for their shift. According to Jeremy Blowers, executive director of the Ontario Regiment Museum, the procedure takes less than 60 seconds to complete.
If the screening questions are not answered correctly or the temperature scan fails, the system sends an SMS message to managers phones informing them that a person in the facility has failed the COVID screening. The user does not learn that the screening failed, for fear of creating alarm. For example, a previous iteration of the system displayed on the monitor a live infrared image. Blowers asked CloudConstable to remove the image in case it showed elevated temperatures and upset the volunteer.
Related: Contactless temperature screening stations deployed in Chinese and Korean universities
In the case of a fail result, a human employee delivers a second set of screening questions. They also give the volunteer time to cool down, to account for artificially elevated skin temperatures after working outside on a hot day, for example. A second temperature scan with a hand device then takes place and management decides whether or not to allow the volunteer access to the building.
If volunteers want the system to recognize them, they must register with the software and allow to the system to learn what their face looks like. A video teaches volunteers how to work with the AI in order to allow her to recognize them, for instance by taking off their hats, eyeglasses, and/or masks during the registration process, says Blowers. Lana surprised museum staff by learning within two weeks how to recognize registered volunteers even if they had their masks on, Blowers adds
Once a volunteer registers, the AI greets them, informs them they are checked in, and thanks them for volunteering at the museum, all by name. Museum management receives compiled reports on check-in, check-out, and total volunteer hours on site.
AVAs development began in the fall of 2018 using the Intel distribution of OpenVINO toolkit, open source software designed to optimize deep learning models from pre-built frameworks and ease the deployment of inference engines onto Intel devices. CloudConstable used pre-trained convolutional neural network models for face detection and head pose detection that the company supplemented with a rules-based algorithm based on the inference results from the head pose model.
Because the AI only asks yes or no questions during the COVID-19 screening, Microsoft Azures speech-to-text API suits this and other AVA deployments, says Pickering. Head pose detection algorithms can also determine whether the volunteer nods or shakes their heads and translate the motion as a yes or no answer respectively.
All data generated by interacting with the volunteers, including the answers given to the screening questions and thermal scan results, stores on the Microsoft Azure cloud service.
No false negative cases in COVID-19 detection results exist to date, verified by a lack of reported cases among staff or their families, according to Blowers. False alarms have occurred, however, including two cases where volunteers were working outside in 42 C weather while wearing black hats, which elevated their skin temperature.
CloudConstable currently experiments with using the Intel RealSense 455 model for future AVA deployments. The camera has a wider FOV than the RealSense 415 and therefore presents less of a challenge for tall users. Both cameras use the same SDK such that the 455 can swap out with the 415 without any required software updates. The larger 455 model does require a larger mount than the 415 model, however.
See the original post:
artificial intelligence assistant uses face recognition and thermal scanning to screen for COVID-19 - Vision Systems Design
- 5 Artificial Intelligence (AI) Stocks That Are Far Better Buys Than Palantir - The Motley Fool - September 21st, 2025 [September 21st, 2025]
- Artificial intelligence ushers in a golden age of hacking, experts say - The Washington Post - September 21st, 2025 [September 21st, 2025]
- Prediction: 1 Artificial Intelligence (AI) Stock to Buy Before It Soars 10X in the Next Decade - The Globe and Mail - September 21st, 2025 [September 21st, 2025]
- This Fantastic Artificial Intelligence (AI) Stock Is on Track for a Blowout Quarter, and It Could Keep Climbing for Years to Come - AOL.com - September 21st, 2025 [September 21st, 2025]
- Meet the Newest Artificial Intelligence (AI) Stock in the S&P 500. It's Up 5,660% Since 2023, and It Could Still Climb Higher From Here. - Yahoo... - September 21st, 2025 [September 21st, 2025]
- Got $3,000? 2 Artificial Intelligence (AI) Stocks to Buy and Hold for the Long Term - The Globe and Mail - September 21st, 2025 [September 21st, 2025]
- Testimony Re: Bills Related to Artificial Intelligence and Algorithms - Cato Institute - September 21st, 2025 [September 21st, 2025]
- Prediction: This Artificial Intelligence (AI) Stock Will Become the First $6 Trillion Company, According to a Wall Street Analyst - The Motley Fool - September 21st, 2025 [September 21st, 2025]
- Lithuania launches X-WING: precision attack drone with autonomy and artificial intelligence - MSN - September 21st, 2025 [September 21st, 2025]
- Artificial Intelligence in Non-invasive Hemodynamic Monitoring: A Systematic Review of Accuracy, Effectiveness, and Clinical Applicability in... - September 21st, 2025 [September 21st, 2025]
- Three Things: Dax, artificial intelligence and broadcaster - Philomath News - September 21st, 2025 [September 21st, 2025]
- This Fantastic Artificial Intelligence (AI) Stock Is on Track for a Blowout Quarter, and It Could Keep Climbing for Years to Come - The Motley Fool - September 21st, 2025 [September 21st, 2025]
- Dual site external validation of artificial intelligence-enabled treatment monitoring for neovascular age-related macular degeneration in England -... - September 21st, 2025 [September 21st, 2025]
- Undervalued and Ignored: 1 Artificial Intelligence (AI) Stock With Room to Run - The Motley Fool - September 21st, 2025 [September 21st, 2025]
- AI-Powered Insights: How Artificial Intelligence Is Transforming Type 2 Diabetes Care and Management - Diabetes In Control - September 21st, 2025 [September 21st, 2025]
- Peer review in the age of artificial intelligence - Physics World - September 21st, 2025 [September 21st, 2025]
- Microsoft Just Gave Investors 17.4 Billion Reasons to Buy This Monster Artificial Intelligence (AI) Data Center Stock Hand Over Fist - Nasdaq - September 21st, 2025 [September 21st, 2025]
- Meet The Unstoppable Artificial Intelligence (AI) Stock That Has Jumped 112% in 6 Months. It Can Still Soar Higher. - The Motley Fool - September 21st, 2025 [September 21st, 2025]
- Time To Change! Here Are The Best AI Laptop Recommendations That Are Superior For Optimal Performance In Artificial Intelligence - VOI.ID - September 21st, 2025 [September 21st, 2025]
- 2 Artificial Intelligence (AI) Leaders to Buy and Hold Forever - Yahoo Finance - September 21st, 2025 [September 21st, 2025]
- Undervalued and Ignored: 1 Artificial Intelligence (AI) Stock With Room to Run - Nasdaq - September 21st, 2025 [September 21st, 2025]
- 2 Trillion-Dollar Artificial Intelligence (AI) Stocks That Can Plunge Up to 95%, According to Select Wall Street Analysts - Nasdaq - September 21st, 2025 [September 21st, 2025]
- Meet The Unstoppable Artificial Intelligence (AI) Stock That Has Jumped 112% in 6 Months. It Can Still Soar Higher. - Nasdaq - September 21st, 2025 [September 21st, 2025]
- Artificial Intelligence and Digital Biomarkers in Hepatology: Critical Perspectives, Emerging Evidence, and Future Directions - Cureus - September 21st, 2025 [September 21st, 2025]
- Is Artificial Intelligence Worth the Investment? - Foreign Policy - September 19th, 2025 [September 19th, 2025]
- The Smartest Artificial Intelligence (AI) Stocks to Buy With $1,000 - Yahoo Finance - September 19th, 2025 [September 19th, 2025]
- Artificial Intelligence News for the Week of September 19; Updates from Druid AI, DxC Technology, G-P & More - solutionsreview.com - September 19th, 2025 [September 19th, 2025]
- Google and PayPal: The Artificial Intelligence (AI) Agent Revolution Is Here - The Motley Fool - September 19th, 2025 [September 19th, 2025]
- Video New book warns of threats to humanity from artificial intelligence - ABC News - Breaking News, Latest News and Videos - September 19th, 2025 [September 19th, 2025]
- Meet The Unstoppable Artificial Intelligence (AI) Stock That Has Jumped 112% in 6 Months. It Can Still Soar Higher. - Yahoo Finance - September 19th, 2025 [September 19th, 2025]
- When Artificial Intelligence Meets Jewish Wisdom - The Times of Israel - September 19th, 2025 [September 19th, 2025]
- How artificial intelligence is reshaping success in small businesses - Digital Journal - September 19th, 2025 [September 19th, 2025]
- 3 Popular Artificial Intelligence (AI) Stocks to Steer Clear Of. (Hint: One of Them Is Palantir) - The Motley Fool - September 19th, 2025 [September 19th, 2025]
- Mace Opens Hearing on the Future of Artificial Intelligence - House.gov - September 19th, 2025 [September 19th, 2025]
- Mustek Expands Into Artificial Intelligence With Majority Stake in Business AI - TechAfrica News - September 19th, 2025 [September 19th, 2025]
- Hearing Wrap Up: The U.S. Must Develop and Advance Artificial Intelligence to Dominate the Tech Race - House.gov - September 19th, 2025 [September 19th, 2025]
- The Role of Artificial Intelligence in Environment, Health, and Safety - Wolters Kluwer - September 19th, 2025 [September 19th, 2025]
- Artificial Intelligence - AI Update, September 19, 2025: AI News and Views From the Past Week - MarketingProfs - September 19th, 2025 [September 19th, 2025]
- Artificial Intelligence in the Bakken discussion - The Bismarck Tribune - September 19th, 2025 [September 19th, 2025]
- VERSABANK IMPLEMENTS NEW INTERNALLY DEVELOPED ARTIFICIAL INTELLIGENCE CAPABLITIES WITHIN CORE BANKING TECHNOLOGY - PR Newswire - September 19th, 2025 [September 19th, 2025]
- Evaluating the Diagnostic Accuracy of an Artificial Intelligence Tool for Pulmonary Abnormalities in Chest Radiographs: A Retrospective Study - Cureus - September 19th, 2025 [September 19th, 2025]
- AI is called artificial intelligence for a reason - The Charlotte News - September 19th, 2025 [September 19th, 2025]
- Artificial Intelligence Will Never Replace PsychiatryBut It Will Try to Destroy It - Psychiatric Times - September 19th, 2025 [September 19th, 2025]
- Europe Stereotactic Neuro-Navigation System Market Report 2025-2035 | Opportunities Fueled by Integration of Artificial Intelligence (AI) and Machine... - September 19th, 2025 [September 19th, 2025]
- Wide ranging experts envision future of artificial intelligence in Middlebury this week - Addison Independent - September 19th, 2025 [September 19th, 2025]
- 3D Bioprinting and Artificial Intelligence for Tumor Microenvironment Modeling: A Scoping Review of Models, Methods, and Integration Pathways - ACS... - September 19th, 2025 [September 19th, 2025]
- What's Behind Nvidia's Huge Artificial Intelligence (AI) Investment in the U.K.? - The Globe and Mail - September 19th, 2025 [September 19th, 2025]
- Prediction: This Artificial Intelligence (AI) Stock With a $455 Billion Revenue Pipeline Will Be Worth $3 Trillion in 5 Years - Nasdaq - September 19th, 2025 [September 19th, 2025]
- Medical Artificial Intelligence Advances with CPC-Bench, Evaluating LLMs on 7102 Cases and Achieving 67% Physician Validation - Quantum Zeitgeist - September 19th, 2025 [September 19th, 2025]
- Is Oracle a Good Artificial Intelligence Stock to Buy? - The Motley Fool - September 17th, 2025 [September 17th, 2025]
- 2 Top Artificial Intelligence (AI) Stocks to Buy With $1,000 Right Now - AOL.com - September 17th, 2025 [September 17th, 2025]
- Artificial Intelligence (AI) in Construction Strategic Intelligence Report 2025-2030: Rising Demand for Automation and Efficiency, Focus on... - September 17th, 2025 [September 17th, 2025]
- How AWS, The Ocean Cleanup, and artificial intelligence are finding ocean plastic - Amazon Sustainability - September 17th, 2025 [September 17th, 2025]
- The Artificial Intelligence Agenda from Capitol Hill to State Capitals: Where We Are and Where We Are (Probably) Going - Crowell & Moring LLP - September 17th, 2025 [September 17th, 2025]
- 2 Artificial Intelligence (AI) Leaders to Buy and Hold Forever - The Motley Fool - September 17th, 2025 [September 17th, 2025]
- Expert Analysis of Ethical Issues in Applying Artificial Intelligence to Cybersecurity - latesthackingnews.com - September 17th, 2025 [September 17th, 2025]
- Billionaire David Tepper of Appaloosa Is Buying 3 Trillion-Dollar Artificial Intelligence (AI) Stocks and Selling 3 Others - The Motley Fool - September 17th, 2025 [September 17th, 2025]
- Research on the influencing factors of generative artificial intelligence usage intent in post-secondary education: an empirical analysis based on the... - September 17th, 2025 [September 17th, 2025]
- Stony Brook University Receives $13.77M NSF Grant to Deploy a National Supercomputer to Democratize Access to Artificial Intelligence and Research... - September 17th, 2025 [September 17th, 2025]
- UK to be first college in KY to offer Artificial Intelligence as a major - LEX18 - September 17th, 2025 [September 17th, 2025]
- AI in classroom NC | Board of education considers policy for artificial intelligence in Wake County Public School district - ABC11 - September 17th, 2025 [September 17th, 2025]
- Remote Patient Monitoring and Artificial Intelligence - AJMC - September 17th, 2025 [September 17th, 2025]
- Ohio brings on artificial intelligence chatbot app to help fight crime, terrorism - The Statehouse News Bureau - September 17th, 2025 [September 17th, 2025]
- Prediction: Oracle Will Surpass Amazon, Microsoft, and Google to Become the Top Cloud for Artificial Intelligence (AI) By 2031 - The Motley Fool - September 17th, 2025 [September 17th, 2025]
- Artificial intelligence may begin impacting the price you pay to fly - NBC10 Philadelphia - September 17th, 2025 [September 17th, 2025]
- 2 Artificial Intelligence (AI) Leaders to Buy and Hold Forever - The Globe and Mail - September 17th, 2025 [September 17th, 2025]
- Understanding the Legal Hurdles of Artificial Intelligence: Questions to Ask and How to be Protected - Law.com - September 17th, 2025 [September 17th, 2025]
- Artificial Intelligence in Livestock Farming Market Current Scenario with Future Trends Analysis to 2034 - openPR.com - September 17th, 2025 [September 17th, 2025]
- 3 Top Artificial Intelligence (AI) Stocks to Buy and Hold Forever - The Motley Fool - September 17th, 2025 [September 17th, 2025]
- Should You Use Artificial Intelligence as Your Therapist? - US News Health - September 17th, 2025 [September 17th, 2025]
- Artificial Intelligence Chipset Market is on an Upward Growth Curve - openPR.com - September 17th, 2025 [September 17th, 2025]
- Prediction: This Artificial Intelligence (AI) Stock Will Be Worth $10 Trillion in 5 Years - The Motley Fool - September 15th, 2025 [September 15th, 2025]
- This Sci-Fi Box Office Hit About Artificial Intelligence Was Rejected By Denzel Washington - SlashFilm - September 15th, 2025 [September 15th, 2025]
- Congress and Artificial Intelligence | Interview: Adam Thierer - The Dispatch - September 15th, 2025 [September 15th, 2025]
- Protecting and empowering workers in an age of artificial intelligence Lessons from the Biden-Harris administration - Economic Policy Institute - September 15th, 2025 [September 15th, 2025]
- Remote monitoring and artificial intelligence in treating patients with heart failure - Medical Xpress - September 15th, 2025 [September 15th, 2025]
- Nvidia Has $4.3 Billion Invested in These 6 Artificial Intelligence (AI) Stocks. Here's the Best of the Bunch. - The Motley Fool - September 15th, 2025 [September 15th, 2025]
- Using Artificial Intelligence in the Search Process for Systematic Reviews - Pan American Health Organization (PAHO) - September 15th, 2025 [September 15th, 2025]
- Prediction: This Artificial Intelligence (AI) Stock Will Beat Opendoor Technologies over the Next 3 Years - The Motley Fool - September 15th, 2025 [September 15th, 2025]
- How artificial intelligence is impacting education - WZZM13.com - September 15th, 2025 [September 15th, 2025]