artificial intelligence assistant uses face recognition and thermal scanning to screen for COVID-19 – Vision Systems Design
An artificial intelligence system originally designed to greet event attendees has evolved into a COVID-19 screening system that protects Canadas largest and most valuable collection of operational, historic military vehicles.
Master Cpl. Lana, an AI assistant developed by CloudConstable (Richmond Hill, Ontario, Canada; http://www.cloudconstable.com) utilizes an Intel (Santa Clara, CA, USA; http://www.intel.com) RealSense 415 3D depth camera and a FLIR (Wilsonville, OR, USA; http://www.flir.com) Lepton 2.5 thermal imaging module to greet volunteers at the Ontario Regiment Museum (Oshawa, Ontario, Canada; http://www.ontrmuseum.ca) and screen them for COVID-19 infection.
The museum originally intended to deploy the AI as a greeter at the museums front entrance, or to provide supplemental information at exhibits (Figure 1). The COVID-19 outbreak forced the museum to temporarily close for visitors, but volunteers still had to continue performing maintenance on the museums collection, however, and a second deployment of the technology was installed inside a vestibule located in the vehicle garage.
The systems hardware attaches to several brackets on a wall mount assembly using pieces of wall track. The Lepton 2.5 module, which connects to the platform using a USB2 cable, sits in a custom-fabricated housing placed above the screen. The RealSense 415 camera, which connects with the platform via USB3 cable, mounts to the same housing.
The housing attaches to a servomechanism designed with off-the-shelf parts that controls a pan/tilt mount. If the subjects face is not entirely within the cameras FOV, as determined by the systems face detection inference models, the software issues servo motion control commands in real time from the hardware platform via serial over USB API calls, to adjust the camera position until the subjects face is clearly visible An array with speaker and microphone sits below the screen.
Related: Artificial intelligence software expands capabilities of Boston Dynamics Spot robot
The company first experimented with using webcams for the system, but the cameras lacked depth sensing capability, according to Michael Pickering, President and CEO at CloudConstable. The system only interacts with users standing within approximately two yards of the screen. Doing so protects the privacy of anyone passing within the cameras FOV but not interacting with the system.
Other camera options evaluated include the Kinect Azure from Microsoft (Redmond, WA, US; http://www.microsoft.com), which had the advantage of a built-in microphone array, and several models of depth camera from ASUS (Beitou District, Taipei, Taiwan; http://www.asus.com). CloudConstable had difficulty finding any of these cameras readily available in Canada, however, and chose the RealSense camera.
Affordability drove the selection of the FLIR Lepton 2.5 module, capable of radiometric calibration with an acceptable resolution for the application, as well as the modules readily available API and SDK, says Pickering.
The AIs platform, an Intel NUC 9 Pro Kit, a PC with a 238 x 216 x 96 mm footprint, mounts behind the screen. The NUC 9 Pro includes an Intel Xeon E-2286M processor, 16 GBof DDR4-2666 memory, and an integrated UHD Graphics P630 GPU. CloudConstable chose the PC for its ability to also run a discrete GPU, in this case an ASUS Dual GeForce RTX 2070 MINI 8 GB GDDR6, to dedicate to graphics processing and ensure smooth, realistic animations. This allows inference processes to run strictly on the integrated GPU. The NUC 9 Pro also includes remote management software, allowing the company to provide off-site support.
Ambient light proves sufficient at most deployments of the AVA system, says Pickering. A simple LED light can provide extra illumination if required, such as inside the vestibule where museum volunteers go through their automated COVID-19 screening.
Volunteers stand in front of a high-definition ACER (San Jose, CA, USA; http://www.acer.com) display, on which Master Cpl. Lana appears (Figure 2). Pickering notes that the system supports multiple display types, however. The AI asks and the volunteer answers a set of COVID-19 screening questions, such as whether the volunteer is experiencing symptoms or has been exposed to anyone with the illness. The system then measures the volunteers skin temperature using the thermal imaging module.
If the volunteer correctly answers the screening questions and passes the temperature scan, they are checked in by the system and proceed into the museum for their shift. According to Jeremy Blowers, executive director of the Ontario Regiment Museum, the procedure takes less than 60 seconds to complete.
If the screening questions are not answered correctly or the temperature scan fails, the system sends an SMS message to managers phones informing them that a person in the facility has failed the COVID screening. The user does not learn that the screening failed, for fear of creating alarm. For example, a previous iteration of the system displayed on the monitor a live infrared image. Blowers asked CloudConstable to remove the image in case it showed elevated temperatures and upset the volunteer.
Related: Contactless temperature screening stations deployed in Chinese and Korean universities
In the case of a fail result, a human employee delivers a second set of screening questions. They also give the volunteer time to cool down, to account for artificially elevated skin temperatures after working outside on a hot day, for example. A second temperature scan with a hand device then takes place and management decides whether or not to allow the volunteer access to the building.
If volunteers want the system to recognize them, they must register with the software and allow to the system to learn what their face looks like. A video teaches volunteers how to work with the AI in order to allow her to recognize them, for instance by taking off their hats, eyeglasses, and/or masks during the registration process, says Blowers. Lana surprised museum staff by learning within two weeks how to recognize registered volunteers even if they had their masks on, Blowers adds
Once a volunteer registers, the AI greets them, informs them they are checked in, and thanks them for volunteering at the museum, all by name. Museum management receives compiled reports on check-in, check-out, and total volunteer hours on site.
AVAs development began in the fall of 2018 using the Intel distribution of OpenVINO toolkit, open source software designed to optimize deep learning models from pre-built frameworks and ease the deployment of inference engines onto Intel devices. CloudConstable used pre-trained convolutional neural network models for face detection and head pose detection that the company supplemented with a rules-based algorithm based on the inference results from the head pose model.
Because the AI only asks yes or no questions during the COVID-19 screening, Microsoft Azures speech-to-text API suits this and other AVA deployments, says Pickering. Head pose detection algorithms can also determine whether the volunteer nods or shakes their heads and translate the motion as a yes or no answer respectively.
All data generated by interacting with the volunteers, including the answers given to the screening questions and thermal scan results, stores on the Microsoft Azure cloud service.
No false negative cases in COVID-19 detection results exist to date, verified by a lack of reported cases among staff or their families, according to Blowers. False alarms have occurred, however, including two cases where volunteers were working outside in 42 C weather while wearing black hats, which elevated their skin temperature.
CloudConstable currently experiments with using the Intel RealSense 455 model for future AVA deployments. The camera has a wider FOV than the RealSense 415 and therefore presents less of a challenge for tall users. Both cameras use the same SDK such that the 455 can swap out with the 415 without any required software updates. The larger 455 model does require a larger mount than the 415 model, however.
See the original post:
artificial intelligence assistant uses face recognition and thermal scanning to screen for COVID-19 - Vision Systems Design
- EU to invest $1.4 billion in artificial intelligence, cybersecurity and digital skills - Reuters - March 28th, 2025 [March 28th, 2025]
- Virginia Governor Vetoes Artificial Intelligence Bill HB 2094: What the Veto Means for Businesses - Ogletree Deakins - March 28th, 2025 [March 28th, 2025]
- Artificial Intelligence, China, and Americas Next Industrial Revolution - The National Interest Online - March 28th, 2025 [March 28th, 2025]
- SEC Roundtable on Artificial Intelligence in the Financial Industry - SEC.gov - March 28th, 2025 [March 28th, 2025]
- Prediction: This Artificial Intelligence (AI) Stock Will Join Nvidia, Meta Platforms, Apple, Microsoft, Amazon, and Alphabet in the Trillion-Dollar... - March 28th, 2025 [March 28th, 2025]
- 3 Subtle Ways Warren Buffett Is Investing in the $15.7 Trillion Artificial Intelligence (AI) Revolution - The Motley Fool - March 28th, 2025 [March 28th, 2025]
- Did Artificial Intelligence Technology Drive Startup Activity in the US from 2010 to 2023? - International Banker - March 28th, 2025 [March 28th, 2025]
- Data and artificial intelligence: the fuel behind space discovery - SpaceNews - March 28th, 2025 [March 28th, 2025]
- How Artificial Intelligence is Transforming PlayStation Games - PSX Extreme - March 28th, 2025 [March 28th, 2025]
- The Role of Artificial Intelligence in the Prediction, Diagnosis, and Management of Cardiovascular Diseases: A Narrative Review - Cureus - March 28th, 2025 [March 28th, 2025]
- Red Team Tactics Grow More Sophisticated with Advancements in Artificial Intelligence - GBHackers - March 28th, 2025 [March 28th, 2025]
- YOUR BITES, YOUR RIGHTS: PEPSI USES ARTIFICIAL INTELLIGENCE TO REINVENT THE WAY YOU ORDER FOOD - MarComm News - March 28th, 2025 [March 28th, 2025]
- Before You Rush to Buy Nvidia, Here Are 3 Artificial Intelligence (AI) Stocks You Can't Afford to Ignore - The Motley Fool - March 28th, 2025 [March 28th, 2025]
- Cleveland Clinic and G42 to Advance Healthcare through Artificial Intelligence - Cleveland Clinic Newsroom - March 28th, 2025 [March 28th, 2025]
- Threat to the development of artificial intelligence: China expects shortage of American processors - - March 28th, 2025 [March 28th, 2025]
- Will the Truth Survive Artificial Intelligence? Our Next Live Debate! - The FP - March 28th, 2025 [March 28th, 2025]
- Artificial Intelligence and Robotics in Minimally Invasive and Complex Surgical Procedures: A Systematic Review - Cureus - March 28th, 2025 [March 28th, 2025]
- An artificial intelligence agent developed in Cuba has been presented - CiberCuba - March 28th, 2025 [March 28th, 2025]
- Prediction: These 2 Unstoppable Artificial Intelligence (AI) Stocks Will Be Worth More Than $1 Trillion by the End of 2025 - Nasdaq - March 28th, 2025 [March 28th, 2025]
- Artificial intelligence and the law in the Philippines - Law.asia - March 28th, 2025 [March 28th, 2025]
- Doctor explains how artificial intelligence is already being deployed in medical care - The Southern - March 28th, 2025 [March 28th, 2025]
- News | Tech experts, hoteliers press for wider adoption of artificial intelligence in hospitality - CoStar Group - March 28th, 2025 [March 28th, 2025]
- EU to invest $1.4 billion in artificial intelligence, cybersecurity and digital skills - Global Banking And Finance Review - March 28th, 2025 [March 28th, 2025]
- SoundHound AI Has Been My Favorite Artificial Intelligence Stock in 2025. Here's Why I'm Not Changing Course in the Sell-Off. - The Motley Fool - March 28th, 2025 [March 28th, 2025]
- 1 Surprising Artificial Intelligence (AI) Stock Warren Buffett Owns That Investors Should Buy on the Dip - The Motley Fool - March 28th, 2025 [March 28th, 2025]
- AI: How Alignment and Inertia Will Determine Higher Education's Artificial Intelligence Success - Fast Company - March 28th, 2025 [March 28th, 2025]
- Lexington-Richland 5 considers using artificial intelligence in schools - Lexington County Chronicle - March 28th, 2025 [March 28th, 2025]
- Artificial intelligence to be used in Arizona's wildfire defense - FOX 10 News Phoenix - March 25th, 2025 [March 25th, 2025]
- Artificial Intelligence: Supercharging Science - Hoover Institution - March 25th, 2025 [March 25th, 2025]
- Artificial Intelligence is Transforming Jobs and Dramatically Changing the Workplace - WorkersCompensation.com - March 25th, 2025 [March 25th, 2025]
- Is AI coming for your job? Artificial intelligence is changing careers in various fields - Local 3 News - March 25th, 2025 [March 25th, 2025]
- Prediction: These 2 Artificial Intelligence (AI) Semiconductor Stocks Will Reclaim Their Spots in the Trillion-Dollar Club by Year's End - The Motley... - March 25th, 2025 [March 25th, 2025]
- Moorfields Eye Hospital INSIGHT research hub will collaborate with artificial intelligence development company Insitro - Ophthalmology Times Europe - March 25th, 2025 [March 25th, 2025]
- Psychometric properties and Turkish adaptation of the artificial intelligence attitude scale (AIAS-4): evidence for construct validity - BMC... - March 25th, 2025 [March 25th, 2025]
- DakotaCon speakers focus on artificial intelligence and gathering intel - Madison Daily Leader - March 25th, 2025 [March 25th, 2025]
- Insight into computer technology and artificial intelligence (AI) - European Patent Office - March 25th, 2025 [March 25th, 2025]
- Coming Soon: The Advertising Industry, New and Improved With Artificial Intelligence - TVRev - March 25th, 2025 [March 25th, 2025]
- Less Than Half of Investors Are Bullish on Artificial Intelligence-Based Crypto Products: CoinGecko Survey - The Daily Hodl - March 25th, 2025 [March 25th, 2025]
- Artificial General Intelligence: What Are We Investing In? - Tech Policy Press - March 25th, 2025 [March 25th, 2025]
- Prediction: 2 Bargain Artificial Intelligence (AI) Stocks That Will Be Worth More Than Palantir Technologies by 2026 - The Motley Fool - March 25th, 2025 [March 25th, 2025]
- BEVERLY HILLS CONFERENCE & VISITORS BUREAU LAUNCHES /IMAGINE BEVERLY HILLS, LEVERAGING ARTIFICIAL INTELLIGENCE TO INSPIRE THE NEXT GENERATION OF... - March 25th, 2025 [March 25th, 2025]
- Do artificial intelligence agents herald a brave new era in investments? - IPE.com - March 25th, 2025 [March 25th, 2025]
- Prediction: These 2 Artificial Intelligence (AI) Semiconductor Stocks Will Reclaim Their Spots in the Trillion-Dollar Club by Year's End - MSN - March 25th, 2025 [March 25th, 2025]
- Artificial Intelligence Won't Replace You - AGInfo Ag Information Network - March 25th, 2025 [March 25th, 2025]
- Jousef Murad: From Data to Deals - How Artificial Intelligence Is a Gamechanger in Lead Generation - openPR - March 25th, 2025 [March 25th, 2025]
- Artificial intelligence: key updates and developments (10 24 March) - Lexology - March 25th, 2025 [March 25th, 2025]
- Grubby AI: the ultimate tool to humanize texts written by Artificial Intelligence - The Cryptonomist - March 25th, 2025 [March 25th, 2025]
- This Nvidia-Backed Artificial Intelligence (AI) Unicorn Is About to Go Public. Here Are 2 Reasons I Won't Be Investing. - The Motley Fool - March 25th, 2025 [March 25th, 2025]
- 4 Top Artificial Intelligence (AI) Stocks Ready for a Bull Run - The Motley Fool - March 25th, 2025 [March 25th, 2025]
- Here Are the 41 Most Disruptive Leaders in the Artificial Intelligence Industry - Built In - March 25th, 2025 [March 25th, 2025]
- Nvidia Is Down 23% From Its Peak. Here's How the Rest of 2025 Could Play Out for This Artificial Intelligence (AI) Powerhouse. - The Motley Fool - March 25th, 2025 [March 25th, 2025]
- Does AI have a soul?: Artificial intelligence conference in Ashland tackles big questions - Ashland.news - March 25th, 2025 [March 25th, 2025]
- The most innovative companies in artificial intelligence for 2025 - Fast Company - March 25th, 2025 [March 25th, 2025]
- The Influence of Artificial Intelligence on the Agile Development Software Market - openPR - March 25th, 2025 [March 25th, 2025]
- The role of artificial intelligence in modern market research - London Daily News - March 25th, 2025 [March 25th, 2025]
- Artificial Intelligence: UK pension funds optimistic but wary as they dip into AI - IPE.com - March 25th, 2025 [March 25th, 2025]
- 2 Artificial Intelligence (AI) Stocks to Buy Before They Soar to $4 Trillion, According to Certain Wall Street Analysts - The Motley Fool - March 25th, 2025 [March 25th, 2025]
- Senate bill targets the use of artificial intelligence in Mississippi - WAPT Jackson - March 15th, 2025 [March 15th, 2025]
- will.i.am and Sean Paul on embracing artificial intelligence in music - Sky News - March 15th, 2025 [March 15th, 2025]
- As Artificial Intelligence (AI) Stocks Fall, Investors Should Consider Buying More of These 2 Powerhouses - The Motley Fool - March 15th, 2025 [March 15th, 2025]
- FSUs Graduate School hosts workshop on artificial intelligence to explore the impact of AI on teaching and research - Florida State News - March 15th, 2025 [March 15th, 2025]
- Artificial Intelligence Optimization (AIO): The Next Frontier in SEO - hackernoon.com - March 15th, 2025 [March 15th, 2025]
- The U.S. Army, Artificial Intelligence, and Mission Command - War On The Rocks - March 15th, 2025 [March 15th, 2025]
- 2 Stock-Split Artificial Intelligence (AI) Stocks to Buy Before They Zoom Higher, According to Wall Street Analysts - The Motley Fool - March 15th, 2025 [March 15th, 2025]
- AI in the classroom: How artificial intelligence is helping teachers - Bay News 9 - March 15th, 2025 [March 15th, 2025]
- Video: Daryl Morey Says 76ers Use Artificial Intelligence for Input on Team Decisions - Bleacher Report - March 15th, 2025 [March 15th, 2025]
- Better Artificial Intelligence Stock: AT&T vs. Verizon Communications - The Motley Fool - March 15th, 2025 [March 15th, 2025]
- NVIDIA GTC 25: What To Expect From the Years Biggest Artificial Intelligence Event - BizTech Magazine - March 15th, 2025 [March 15th, 2025]
- 2 Stock-Split Artificial Intelligence (AI) Stocks to Buy Before They Zoom Higher, According to Wall Street Analysts - MSN - March 15th, 2025 [March 15th, 2025]
- DEI Erosion Threatens Safety. Artificial Intelligence May Help Pick Up the Slack. - Inbound Logistics - March 15th, 2025 [March 15th, 2025]
- Saint Vincent conference will examine broad impact of artificial intelligence - TribLIVE - March 15th, 2025 [March 15th, 2025]
- As Artificial Intelligence (AI) Stocks Fall, Investors Should Consider Buying More of These 2 Powerhouses - MSN - March 15th, 2025 [March 15th, 2025]
- 3 Artificial Intelligence (AI) Stocks You Can Buy and Hold for the Next Decade - The Motley Fool - March 15th, 2025 [March 15th, 2025]
- This Artificial Intelligence (AI) Stock Has Surged 1,000% Over the Past 2 Years. Is a Split on the Horizon? - The Motley Fool - March 15th, 2025 [March 15th, 2025]
- Move Over, Artificial Intelligence (AI) -- Businesses Are on Pace to Spend More Than $10 Trillion on This Trend Over the Next Decade - The Motley Fool - March 15th, 2025 [March 15th, 2025]
- Here Is My Top Artificial Intelligence (AI) Stock to Buy Right Now - The Motley Fool - March 15th, 2025 [March 15th, 2025]
- Nasdaq Sell-Off: 2 Artificial Intelligence (AI) Stocks Down 20% and 49% to Buy Hand Over Fist on the Dip - The Motley Fool - March 15th, 2025 [March 15th, 2025]
- 1 Top Artificial Intelligence (AI) Chip Stock to Buy Hand Over Fist Before It Jumps - The Motley Fool - March 15th, 2025 [March 15th, 2025]
- [Latest] How Artificial Intelligence is Shaping the Emc Shielding And Test Equipment Market - openPR - March 15th, 2025 [March 15th, 2025]
- Nasdaq Correction: 5 Reasons Nvidia Stock Is Still a Top Artificial Intelligence (AI) Stock to Buy Right Now - The Motley Fool - March 15th, 2025 [March 15th, 2025]