Oregon is dropping an artificial intelligence tool used in child welfare system – NPR
Sen. Ron Wyden, D-Ore., speaks during a Senate Finance Committee hearing on Oct. 19, 2021. Wyden says he has long been concerned about the algorithms used by his state's child welfare system. Mandel Ngan/AP hide caption
Sen. Ron Wyden, D-Ore., speaks during a Senate Finance Committee hearing on Oct. 19, 2021. Wyden says he has long been concerned about the algorithms used by his state's child welfare system.
Child welfare officials in Oregon will stop using an algorithm to help decide which families are investigated by social workers, opting instead for a new process that officials say will make better, more racially equitable decisions.
The move comes weeks after an Associated Press review of a separate algorithmic tool in Pennsylvania that had originally inspired Oregon officials to develop their model, and was found to have flagged a disproportionate number of Black children for "mandatory" neglect investigations when it first was in place.
Oregon's Department of Human Services announced to staff via email last month that after "extensive analysis" the agency's hotline workers would stop using the algorithm at the end of June to reduce disparities concerning which families are investigated for child abuse and neglect by child protective services.
"We are committed to continuous quality improvement and equity," Lacey Andresen, the agency's deputy director, said in the May 19 email.
Jake Sunderland, a department spokesman, said the existing algorithm would "no longer be necessary," since it can't be used with the state's new screening process. He declined to provide further details about why Oregon decided to replace the algorithm and would not elaborate on any related disparities that influenced the policy change.
Hotline workers' decisions about reports of child abuse and neglect mark a critical moment in the investigations process, when social workers first decide if families should face state intervention. The stakes are high not attending to an allegation could end with a child's death, but scrutinizing a family's life could set them up for separation.
From California to Colorado and Pennsylvania, as child welfare agencies use or consider implementing algorithms, an AP review identified concerns about transparency, reliability and racial disparities in the use of the technology, including their potential to harden bias in the child welfare system.
U.S. Sen. Ron Wyden, an Oregon Democrat, said he had long been concerned about the algorithms used by his state's child welfare system and reached out to the department again following the AP story to ask questions about racial bias a prevailing concern with the growing use of artificial intelligence tools in child protective services.
"Making decisions about what should happen to children and families is far too important a task to give untested algorithms," Wyden said in a statement. "I'm glad the Oregon Department of Human Services is taking the concerns I raised about racial bias seriously and is pausing the use of its screening tool."
Sunderland said Oregon child welfare officials had long been considering changing their investigations process before making the announcement last month.
He added that the state decided recently that the algorithm would be completely replaced by its new program, called the Structured Decision Making model, which aligns with many other child welfare jurisdictions across the country.
Oregon's Safety at Screening Tool was inspired by the influential Allegheny Family Screening Tool, which is named for the county surrounding Pittsburgh, and is aimed at predicting the risk that children face of winding up in foster care or being investigated in the future. It was first implemented in 2018. Social workers view the numerical risk scores the algorithm generates the higher the number, the greater the risk as they decide if a different social worker should go out to investigate the family.
But Oregon officials tweaked their original algorithm to only draw from internal child welfare data in calculating a family's risk, and tried to deliberately address racial bias in its design with a "fairness correction."
In response to Carnegie Mellon University researchers' findings that Allegheny County's algorithm initially flagged a disproportionate number of Black families for "mandatory" child neglect investigations, county officials called the research "hypothetical," and noted that social workers can always override the tool, which was never intended to be used on its own.
Wyden is a chief sponsor of a bill that seeks to establish transparency and national oversight of software, algorithms and other automated systems.
"With the livelihoods and safety of children and families at stake, technology used by the state must be equitable and I will continue to watchdog," Wyden said.
The second tool that Oregon developed an algorithm to help decide when foster care children can be reunified with their families remains on hiatus as researchers rework the model. Sunderland said the pilot was paused months ago due to inadequate data but that there is "no expectation that it will be unpaused soon."
In recent years while under scrutiny by a crisis oversight board ordered by the governor, the state agency currently preparing to hire its eighth new child welfare director in six years considered three additional algorithms, including predictive models that sought to assess a child's risk for death and severe injury, whether children should be placed in foster care, and if so, where. Sunderland said the child welfare department never built those tools, however.
Read this article:
Oregon is dropping an artificial intelligence tool used in child welfare system - NPR
- Impact of Artificial Intelligence (AI) on Media and Creative Industries - EDMO - March 1st, 2025 [March 1st, 2025]
- 1 Artificial Intelligence (AI) Stock That Could Be Bigger Than Nvidia in 5 Years - The Motley Fool - March 1st, 2025 [March 1st, 2025]
- This Artificial Intelligence (AI) Stock Is Up 15% in 2025 Already. It Is Still a Solid Buy? - The Motley Fool - March 1st, 2025 [March 1st, 2025]
- Can artificial intelligence be the future solution to the enormous challenges and suffering caused by Schizophrenia? - Nature.com - March 1st, 2025 [March 1st, 2025]
- Applications of Artificial Intelligence in Medical Education: A Systematic Review - Cureus - March 1st, 2025 [March 1st, 2025]
- This Artificial Intelligence (AI) Stock Is Up 15% in 2025 Already. It Is Still a Solid Buy? - AOL - March 1st, 2025 [March 1st, 2025]
- Federal Executive Forum Artificial Intelligence Strategies in Government Progress and Best Practices 2025 - Federal News Network - March 1st, 2025 [March 1st, 2025]
- Introduction to Artificial Intelligence for General Surgeons: A Narrative Review - Cureus - March 1st, 2025 [March 1st, 2025]
- How is Artificial Intelligence Affecting Health Care? - Workers Comp Forum - March 1st, 2025 [March 1st, 2025]
- 1 Spectacular Artificial Intelligence (AI) Stock to Buy With $50 Right Now - The Motley Fool - March 1st, 2025 [March 1st, 2025]
- 20+ Advantages and Disadvantages of AI | Pros of Artificial Intelligence - Simplilearn - March 1st, 2025 [March 1st, 2025]
- Prediction: This Top Artificial Intelligence (AI) Stock Will Start Skyrocketing After March 6 - The Motley Fool - March 1st, 2025 [March 1st, 2025]
- 1 Surprising Stock Harnessing the Power of Artificial Intelligence (AI) - The Motley Fool - March 1st, 2025 [March 1st, 2025]
- 2 Top Artificial Intelligence (AI) Stocks to Buy On the Dip Amid Nasdaq Selloff - Yahoo Finance - March 1st, 2025 [March 1st, 2025]
- Review: Artificial intelligence is shaping the future of diabetes care - News-Medical.Net - March 1st, 2025 [March 1st, 2025]
- Prediction: This Artificial Intelligence (AI) Stock -- a 1,020% Gainer Since Its IPO -- Won't Split Its Stock in 2025. Here's Why - The Motley Fool - March 1st, 2025 [March 1st, 2025]
- A Nobel laureate on the economics of artificial intelligence - MIT Technology Review - March 1st, 2025 [March 1st, 2025]
- Prediction: This Top Artificial Intelligence (AI) Stock Will Start Skyrocketing After March 6 - Nasdaq - March 1st, 2025 [March 1st, 2025]
- Meta Platforms Just Caused This Crucial Artificial Intelligence (AI) Stock to Plummet. Should You Buy the Dip? - The Motley Fool - March 1st, 2025 [March 1st, 2025]
- Artificial Intelligence - AI Update, February 28, 2025: AI News and Views From the Past Week - MarketingProfs.com - March 1st, 2025 [March 1st, 2025]
- The Ultimate Artificial Intelligence (AI) ETF to Buy With $50 Right Now - The Motley Fool - March 1st, 2025 [March 1st, 2025]
- Prediction: This Artificial Intelligence (AI) Company Will Split Its Stock in 2025 - The Motley Fool - March 1st, 2025 [March 1st, 2025]
- Should You Forget Nvidia and Buy 2 Artificial Intelligence (AI) Stocks Instead? - The Motley Fool - March 1st, 2025 [March 1st, 2025]
- Why Artificial Intelligence Stocks SoundHound AI, IonQ, and C3.ai Are Struggling Today - The Motley Fool - March 1st, 2025 [March 1st, 2025]
- 2 Top Artificial Intelligence (AI) Stocks Ready for a Bull Run - The Motley Fool - March 1st, 2025 [March 1st, 2025]
- AI Cant Do This Anymore: The Dangers of Artificial Intelligence in Academia - Skidmore News - March 1st, 2025 [March 1st, 2025]
- Whats Next in Artificial Intelligence: Agents that can do more than chatbots - Pittsburgh Post-Gazette - February 9th, 2025 [February 9th, 2025]
- Geopolitics of artificial intelligence to be focus of major summit in Paris; AP explains - Yahoo - February 9th, 2025 [February 9th, 2025]
- Geopolitics of artificial intelligence to be focus of major summit in Paris; AP explains - The Associated Press - February 9th, 2025 [February 9th, 2025]
- 3 Top Artificial Intelligence Stocks to Buy in February - MSN - February 9th, 2025 [February 9th, 2025]
- Geopolitics of artificial intelligence to be focus of major summit in Paris; AP explains - Lufkin Daily News - February 9th, 2025 [February 9th, 2025]
- 2 of the Hottest Artificial Intelligence (AI) Stocks on the Planet Can Plunge Up to 94%, According to Select Wall Street Analysts - The Motley Fool - February 9th, 2025 [February 9th, 2025]
- These 2 Stocks Are Leading the Data Center Artificial Intelligence (AI) Trend, but Are They Buys Right Now? - The Motley Fool - February 9th, 2025 [February 9th, 2025]
- Book Review | Genesis: Artificial Intelligence, Hope, and the Human Spirit - LSE - February 9th, 2025 [February 9th, 2025]
- The Artificial Intelligence Action Summit In France: Maintaining The Dialogue On Global AI Regulation - Forrester - February 9th, 2025 [February 9th, 2025]
- Is prediction the next frontier for artificial intelligence? - Healthcare IT News - February 9th, 2025 [February 9th, 2025]
- The Artificial Intelligence in Medicines Market Is Set to Reach $18,119 Million | CAGR of 49.6% - openPR - February 9th, 2025 [February 9th, 2025]
- Geopolitics of artificial intelligence to be focus of major summit in Paris; AP explains - The Audubon County Advocate Journal - February 9th, 2025 [February 9th, 2025]
- Around and About with Richard McCarthy: Asking AI about itself: Will artificial intelligence ever surpass humankind? - GazetteNET - February 9th, 2025 [February 9th, 2025]
- Will the Paris artificial intelligence summit set a unified approach to AI governanceor just be another conference? - Bulletin of the Atomic... - February 9th, 2025 [February 9th, 2025]
- Apple Stock Jumps on Artificial Intelligence (AI) Driving iPhone Sales. Here's Why It's Not Getting Crushed by the DeepSeek Launch. - The Motley Fool - February 9th, 2025 [February 9th, 2025]
- Who will win the race to Artificial General Intelligence? - The Indian Express - February 9th, 2025 [February 9th, 2025]
- Prediction: This Artificial Intelligence (AI) Chip Stock Will Win Big From DeepSeek's Feat - The Motley Fool - February 9th, 2025 [February 9th, 2025]
- Prediction: 2 Artificial Intelligence (AI) Stocks That Will Be Worth More Than Nvidia 3 Years From Now - The Motley Fool - February 9th, 2025 [February 9th, 2025]
- State of Louisiana Launches Innovation Brand, Announces Creation of $50 Million Growth Fund and Artificial Intelligence Research Institute - Louisiana... - February 9th, 2025 [February 9th, 2025]
- Using smart technologies and artificial intelligence in food packaging can reduce food waste - Yahoo News Canada - February 9th, 2025 [February 9th, 2025]
- BigBear.ai Wins Department of Defense Contract to Prototype Near-Peer Adversary Geopolitical Risk Analysis for Chief Digital and Artificial... - February 9th, 2025 [February 9th, 2025]
- Should Investors Change Their Artificial Intelligence (AI) Investment Strategy After the DeepSeek Launch? - The Motley Fool - February 9th, 2025 [February 9th, 2025]
- 1 Unstoppable Artificial Intelligence (AI) Stock to Buy Before It Punches Its Ticket to the $4 Trillion Club - The Motley Fool - February 9th, 2025 [February 9th, 2025]
- Got 10 Years and $1000? These 3 Artificial Intelligence (AI) Stocks Are Set to Soar. - The Motley Fool - February 9th, 2025 [February 9th, 2025]
- 1 Artificial Intelligence (AI) Stock Down 33% to Buy Hand Over Fist, According to Wall Street - The Motley Fool - February 9th, 2025 [February 9th, 2025]
- Rihanna Calls Out Use of Artificial Intelligence on Her Voice to Doctor a Clip of Her Speaking - Billboard - February 9th, 2025 [February 9th, 2025]
- 3 Best Artificial Intelligence (AI) Stocks to Buy in February - The Motley Fool - February 9th, 2025 [February 9th, 2025]
- Buying This Top Artificial Intelligence (AI) Stock Looks Like a No-Brainer Right Now - The Motley Fool - February 9th, 2025 [February 9th, 2025]
- Is Arm Stock a Buy After the Artificial Intelligence (AI) Chip Designer Released Its Quarterly Earnings Report? - The Motley Fool - February 9th, 2025 [February 9th, 2025]
- Artificial Intelligence, the Academy, And A New Studia Humanitatis - Minding The Campus - February 9th, 2025 [February 9th, 2025]
- The Trump Administrations Artificial Intelligence Rollback Is a Chance to Rethink AI Policy - Ms. Magazine - February 5th, 2025 [February 5th, 2025]
- Workday layoffs: California-based company lays off 1,750 employees, 8.5% of its workforce in favor of artificial intelligence - ABC7 Los Angeles - February 5th, 2025 [February 5th, 2025]
- It can really transform lives: Navigating the ethical landscape of artificial intelligence - WKMG News 6 & ClickOrlando - February 5th, 2025 [February 5th, 2025]
- Legal Restrictions Governing Artificial Intelligence in the Workplace - Law.com - February 5th, 2025 [February 5th, 2025]
- Google drops AI weapons banwhat it means for the future of artificial intelligence - VentureBeat - February 5th, 2025 [February 5th, 2025]
- MPs to scrutinise use of artificial intelligence in the finance sector - ComputerWeekly.com - February 5th, 2025 [February 5th, 2025]
- Catalyzing Change: Innovation and Efficiency through Artificial Intelligence in Contracting - United States Army - February 5th, 2025 [February 5th, 2025]
- STSD to hear cost breakdown, address artificial intelligence in education - The Wellsboro Gazette - February 5th, 2025 [February 5th, 2025]
- OECD activities during the Artificial Intelligence (AI) Action Summit - OECD - February 5th, 2025 [February 5th, 2025]
- Tether Ventures Into Artificial Intelligence With New Application Suite - Bitcoin.com News - February 5th, 2025 [February 5th, 2025]
- Will Artificial Intelligence Kill Acting? Nicholas Cage Thinks It Could - Movieguide - February 5th, 2025 [February 5th, 2025]
- 3 Reasons to Buy This Artificial Intelligence (AI) Stock on the Dip - The Motley Fool - February 5th, 2025 [February 5th, 2025]
- 1 No-Brainer Artificial Intelligence (AI) Stock to Buy With $35 and Hold for the Long Run - The Motley Fool - February 5th, 2025 [February 5th, 2025]
- Google renounces its promise not to develop weapons with artificial intelligence - Mezha.Media - February 5th, 2025 [February 5th, 2025]
- DeepSeek Just Changed Generative Artificial Intelligence (AI) Forever. 2 Surprising Winners From Its Innovation. - The Motley Fool - February 5th, 2025 [February 5th, 2025]
- FUTURE-AI: international consensus guideline for trustworthy and deployable artificial intelligence in healthcare - The BMJ - February 5th, 2025 [February 5th, 2025]
- DeepSeek Just Exposed the Biggest Flaw of the Artificial Intelligence (AI) Revolution - The Motley Fool - February 5th, 2025 [February 5th, 2025]
- Artificial Intelligence Is Here: How The Innovative Technology Is Taking Over The Stateline - WREX.com - February 5th, 2025 [February 5th, 2025]
- The Ultimate Artificial Intelligence (AI) Stocks to Buy in 2025 - The Motley Fool - February 5th, 2025 [February 5th, 2025]
- This Magnificent Artificial Intelligence (AI) Stock Has Shot Up Over 175% in Just 3 Months, and It Could Soar Higher in 2025 - The Motley Fool - February 5th, 2025 [February 5th, 2025]
- Artificial intelligence is bringing nuclear power back from the dead maybe even in California - CalMatters - February 5th, 2025 [February 5th, 2025]
- Got $5,000? These Are 3 of the Cheapest Artificial Intelligence Stocks to Buy Right Now - The Motley Fool - February 5th, 2025 [February 5th, 2025]
- Compass Capital partners with MIT Sloan School of Management on an artificial intelligence project - ZAWYA - February 5th, 2025 [February 5th, 2025]
- 3 No-Brainer Artificial Intelligence (AI) Stocks to Buy With $500 Right Now - The Motley Fool - February 5th, 2025 [February 5th, 2025]