New York City wants to restrict artificial intelligence in hiring – CBS News
New York City is trying to rein in the use of algorithms used to screen job applicants. It's one of the first cities in the U.S. to try to regulate what is an increasingly common and opaque hiring practice.
The city council is considering a bill that would require potential employers to notify job candidates about the use of these tools, referred to as "automated decision systems." Companies would also have to complete an annual audit to make sure the technology doesn't result in bias.
The move comes as the use of artificial intelligence in hiring skyrockets, increasingly replacing human screeners. Fortune 500 companies including Delta, Dunkin, Ikea and Unilever have turned to AI for help assessing job applicants. These tools run the gamut from a simple text reader that screens applications for particular words and phrases, to a system that evaluates videos of potential applicants to judge their suitability for the job.
"We have all the reasons to believe that every major company uses some algorithmic hiring," Julia Stoyanovich, a founding director of the Center for Responsible AI at New York University, said in a recent webinar.
At a time when New Yorkers are suffering double-digit unemployment, legislators are concerned about the brave new world of digital hiring. Research has shown that AI systems can introduce more problems than they solve. Facial-recognition tools that use AI have demonstrated trouble in identifying faces of Black people, determining people's sex and wrongly matching members of Congress to a mugshot database.
In perhaps the most notorious example of AI bias, a hiring tool developed internally at Amazon had to be scrapped because it discriminatedagainst women. The tool was developed using a 10-year history of resumes submitted to the company, whose workforce skews male. As a result, the software effectively "taught" itself that male candidates were preferable and demoted applications that included the word "women," or the names of two all-women's colleges. While the tool was never used, it demonstrates the potential pitfalls of substituting machine intelligence for human judgment.
"As legislators in a city home to some of the world's largest corporations, we must intervene and prevent unjust hiring," city council member Laurie Cumbo, the bill's sponsor, said at a hearing for the legislation last week.
Several civil rights groups say New York's proposed bill doesn't go far enough. A dozen groups including the AI Now Institute, New York Civil Liberties Union and New York Communities for Change issued a letter last week pushing for the law to cover more types of automated tools and more steps in the hiring process. They want the measure to include heavier penalties, enabling people to sue if they've been passed over for a job because of biased algorithms. This would be in line with existing employment law, which allows applicants to sue for discrimination because of race or sex.
"If we pass [the bill] as it is worded today, it will be a rubber stamp for some of the worst forms of algorithmic discrimination," Albert Fox Cahn, executive director of the Surveillance Technology Oversight Project, told the city council.
"We need much stronger penalties," he said. "Just as we do with every other form of employment discrimination, we need that private-sector enforcement."
Alicia Mercedes, a spokesperson for Cumbo, the bill's sponsor, said the bill is still in its early stages and is likely to change in response to feedback.
"We're committed to seeing this legislation come out as something that can be effective, so we will of course take any input that we can get from those who are working on these issues every day," Mercedes said.
For hiring professionals, the main appeal of AI is its capacity to save time. But technologists have also touted the potential for automated programs, if used correctly, to eliminate human biases, such as the well-documented tendency for hiring managers to overlook African-American applicants or look favorably on candidates who physically resemble the hiring manager.
"When only a human reviews a resume, unfortunately, humans can't un-see the things that cause unconscious biases if someone went to the same alma mater or grew up in same community," said Athena Karp, CEO of HiredScore, an AI hiring platform.
Karp said she supports the New York bill. "If technologies are used in hiring, the makers of technology, and candidates, can and should know how they're being used," she said at the hearing.
In the U.S., the only place where this is currently the case is in Illinois, whose Biometric Privacy Act requires employers to tell candidates if AI is being used to evaluate them and allows the candidates to opt out. On the federal level, a bill to study bias in algorithms has been introduced in Congress. In New York, most job candidates have no clue they're being screened by software even those who are computer scientists themselves.
"I've received my fair share of job and internship rejections in my graduate and undergraduate careers," said Lauren D'Arinzo, a master's degree candidate in data science and AI at New York University. "It is unsettling to me that a future employer might disregard my application based on the output of an algorithm."
She added, "What worries me most is, had I not been recruited into a project explicitly doing research in this space, I would likely not have even known that these types of tools are regularly used by Fortune 500 companies."
Link:
New York City wants to restrict artificial intelligence in hiring - CBS News
- Whats Next in Artificial Intelligence: Agents that can do more than chatbots - Pittsburgh Post-Gazette - February 9th, 2025 [February 9th, 2025]
- Geopolitics of artificial intelligence to be focus of major summit in Paris; AP explains - Yahoo - February 9th, 2025 [February 9th, 2025]
- Geopolitics of artificial intelligence to be focus of major summit in Paris; AP explains - The Associated Press - February 9th, 2025 [February 9th, 2025]
- 3 Top Artificial Intelligence Stocks to Buy in February - MSN - February 9th, 2025 [February 9th, 2025]
- Geopolitics of artificial intelligence to be focus of major summit in Paris; AP explains - Lufkin Daily News - February 9th, 2025 [February 9th, 2025]
- 2 of the Hottest Artificial Intelligence (AI) Stocks on the Planet Can Plunge Up to 94%, According to Select Wall Street Analysts - The Motley Fool - February 9th, 2025 [February 9th, 2025]
- These 2 Stocks Are Leading the Data Center Artificial Intelligence (AI) Trend, but Are They Buys Right Now? - The Motley Fool - February 9th, 2025 [February 9th, 2025]
- Book Review | Genesis: Artificial Intelligence, Hope, and the Human Spirit - LSE - February 9th, 2025 [February 9th, 2025]
- The Artificial Intelligence Action Summit In France: Maintaining The Dialogue On Global AI Regulation - Forrester - February 9th, 2025 [February 9th, 2025]
- Is prediction the next frontier for artificial intelligence? - Healthcare IT News - February 9th, 2025 [February 9th, 2025]
- The Artificial Intelligence in Medicines Market Is Set to Reach $18,119 Million | CAGR of 49.6% - openPR - February 9th, 2025 [February 9th, 2025]
- Geopolitics of artificial intelligence to be focus of major summit in Paris; AP explains - The Audubon County Advocate Journal - February 9th, 2025 [February 9th, 2025]
- Around and About with Richard McCarthy: Asking AI about itself: Will artificial intelligence ever surpass humankind? - GazetteNET - February 9th, 2025 [February 9th, 2025]
- Will the Paris artificial intelligence summit set a unified approach to AI governanceor just be another conference? - Bulletin of the Atomic... - February 9th, 2025 [February 9th, 2025]
- Apple Stock Jumps on Artificial Intelligence (AI) Driving iPhone Sales. Here's Why It's Not Getting Crushed by the DeepSeek Launch. - The Motley Fool - February 9th, 2025 [February 9th, 2025]
- Who will win the race to Artificial General Intelligence? - The Indian Express - February 9th, 2025 [February 9th, 2025]
- Prediction: This Artificial Intelligence (AI) Chip Stock Will Win Big From DeepSeek's Feat - The Motley Fool - February 9th, 2025 [February 9th, 2025]
- Prediction: 2 Artificial Intelligence (AI) Stocks That Will Be Worth More Than Nvidia 3 Years From Now - The Motley Fool - February 9th, 2025 [February 9th, 2025]
- State of Louisiana Launches Innovation Brand, Announces Creation of $50 Million Growth Fund and Artificial Intelligence Research Institute - Louisiana... - February 9th, 2025 [February 9th, 2025]
- Using smart technologies and artificial intelligence in food packaging can reduce food waste - Yahoo News Canada - February 9th, 2025 [February 9th, 2025]
- BigBear.ai Wins Department of Defense Contract to Prototype Near-Peer Adversary Geopolitical Risk Analysis for Chief Digital and Artificial... - February 9th, 2025 [February 9th, 2025]
- Should Investors Change Their Artificial Intelligence (AI) Investment Strategy After the DeepSeek Launch? - The Motley Fool - February 9th, 2025 [February 9th, 2025]
- 1 Unstoppable Artificial Intelligence (AI) Stock to Buy Before It Punches Its Ticket to the $4 Trillion Club - The Motley Fool - February 9th, 2025 [February 9th, 2025]
- Got 10 Years and $1000? These 3 Artificial Intelligence (AI) Stocks Are Set to Soar. - The Motley Fool - February 9th, 2025 [February 9th, 2025]
- 1 Artificial Intelligence (AI) Stock Down 33% to Buy Hand Over Fist, According to Wall Street - The Motley Fool - February 9th, 2025 [February 9th, 2025]
- Rihanna Calls Out Use of Artificial Intelligence on Her Voice to Doctor a Clip of Her Speaking - Billboard - February 9th, 2025 [February 9th, 2025]
- 3 Best Artificial Intelligence (AI) Stocks to Buy in February - The Motley Fool - February 9th, 2025 [February 9th, 2025]
- Buying This Top Artificial Intelligence (AI) Stock Looks Like a No-Brainer Right Now - The Motley Fool - February 9th, 2025 [February 9th, 2025]
- Is Arm Stock a Buy After the Artificial Intelligence (AI) Chip Designer Released Its Quarterly Earnings Report? - The Motley Fool - February 9th, 2025 [February 9th, 2025]
- Artificial Intelligence, the Academy, And A New Studia Humanitatis - Minding The Campus - February 9th, 2025 [February 9th, 2025]
- The Trump Administrations Artificial Intelligence Rollback Is a Chance to Rethink AI Policy - Ms. Magazine - February 5th, 2025 [February 5th, 2025]
- Workday layoffs: California-based company lays off 1,750 employees, 8.5% of its workforce in favor of artificial intelligence - ABC7 Los Angeles - February 5th, 2025 [February 5th, 2025]
- It can really transform lives: Navigating the ethical landscape of artificial intelligence - WKMG News 6 & ClickOrlando - February 5th, 2025 [February 5th, 2025]
- Legal Restrictions Governing Artificial Intelligence in the Workplace - Law.com - February 5th, 2025 [February 5th, 2025]
- Google drops AI weapons banwhat it means for the future of artificial intelligence - VentureBeat - February 5th, 2025 [February 5th, 2025]
- MPs to scrutinise use of artificial intelligence in the finance sector - ComputerWeekly.com - February 5th, 2025 [February 5th, 2025]
- Catalyzing Change: Innovation and Efficiency through Artificial Intelligence in Contracting - United States Army - February 5th, 2025 [February 5th, 2025]
- STSD to hear cost breakdown, address artificial intelligence in education - The Wellsboro Gazette - February 5th, 2025 [February 5th, 2025]
- OECD activities during the Artificial Intelligence (AI) Action Summit - OECD - February 5th, 2025 [February 5th, 2025]
- Tether Ventures Into Artificial Intelligence With New Application Suite - Bitcoin.com News - February 5th, 2025 [February 5th, 2025]
- Will Artificial Intelligence Kill Acting? Nicholas Cage Thinks It Could - Movieguide - February 5th, 2025 [February 5th, 2025]
- 3 Reasons to Buy This Artificial Intelligence (AI) Stock on the Dip - The Motley Fool - February 5th, 2025 [February 5th, 2025]
- 1 No-Brainer Artificial Intelligence (AI) Stock to Buy With $35 and Hold for the Long Run - The Motley Fool - February 5th, 2025 [February 5th, 2025]
- Google renounces its promise not to develop weapons with artificial intelligence - Mezha.Media - February 5th, 2025 [February 5th, 2025]
- DeepSeek Just Changed Generative Artificial Intelligence (AI) Forever. 2 Surprising Winners From Its Innovation. - The Motley Fool - February 5th, 2025 [February 5th, 2025]
- FUTURE-AI: international consensus guideline for trustworthy and deployable artificial intelligence in healthcare - The BMJ - February 5th, 2025 [February 5th, 2025]
- DeepSeek Just Exposed the Biggest Flaw of the Artificial Intelligence (AI) Revolution - The Motley Fool - February 5th, 2025 [February 5th, 2025]
- Artificial Intelligence Is Here: How The Innovative Technology Is Taking Over The Stateline - WREX.com - February 5th, 2025 [February 5th, 2025]
- The Ultimate Artificial Intelligence (AI) Stocks to Buy in 2025 - The Motley Fool - February 5th, 2025 [February 5th, 2025]
- This Magnificent Artificial Intelligence (AI) Stock Has Shot Up Over 175% in Just 3 Months, and It Could Soar Higher in 2025 - The Motley Fool - February 5th, 2025 [February 5th, 2025]
- Artificial intelligence is bringing nuclear power back from the dead maybe even in California - CalMatters - February 5th, 2025 [February 5th, 2025]
- Got $5,000? These Are 3 of the Cheapest Artificial Intelligence Stocks to Buy Right Now - The Motley Fool - February 5th, 2025 [February 5th, 2025]
- Compass Capital partners with MIT Sloan School of Management on an artificial intelligence project - ZAWYA - February 5th, 2025 [February 5th, 2025]
- 3 No-Brainer Artificial Intelligence (AI) Stocks to Buy With $500 Right Now - The Motley Fool - February 5th, 2025 [February 5th, 2025]
- Nvidia vs. Alphabet: Which Artificial Intelligence (AI) Stock Should You Buy After the Emergence of China's DeepSeek? - The Motley Fool - February 5th, 2025 [February 5th, 2025]
- A look inside the Trump administration approach to artificial intelligence - Federal News Network - February 5th, 2025 [February 5th, 2025]
- Artificial Intelligence (AI) in Cardiology Market Industry Growth Trends: Market Forecast and Revenue Share by 2031 - openPR - February 5th, 2025 [February 5th, 2025]
- Riverhead hospital employees picket for raises, protections from artificial intelligence - RiverheadLOCAL - February 5th, 2025 [February 5th, 2025]
- 1 Wall Street Analyst Thinks This Artificial Intelligence (AI) Chip Stock Could Benefit From DeepSeek's Breakthrough - The Motley Fool - February 5th, 2025 [February 5th, 2025]
- 1 No-Brainer Artificial Intelligence (AI) Stock That Will Crush the Market in 2025 - The Motley Fool - February 5th, 2025 [February 5th, 2025]
- 3 Artificial Intelligence (AI) Stocks That Could Deliver Stunning Returns This Year - The Motley Fool - January 27th, 2025 [January 27th, 2025]
- Trumps White House and the New Artificial Intelligence Era - The Dispatch - January 27th, 2025 [January 27th, 2025]
- Artificial intelligence confirms it - these are the jobs that will become extinct in the next 5 years - Unin Rayo - January 27th, 2025 [January 27th, 2025]
- My Top 2 Artificial Intelligence (AI) Stocks for 2025 (Hint: Nvidia Is Not One of Them) - Nasdaq - January 27th, 2025 [January 27th, 2025]
- Artificial intelligence bill passes in the Arkansas House - THV11.com KTHV - January 27th, 2025 [January 27th, 2025]
- Chen elected fellow of Association for the Advancement of Artificial Intelligence - The Source - WashU - WashU - January 27th, 2025 [January 27th, 2025]
- Nvidia Plummeted Today -- Time to Buy the Artificial Intelligence (AI) Leader's Stock? - The Motley Fool - January 27th, 2025 [January 27th, 2025]
- Super Micro Computer Plummeted Today -- Is It Time to Buy the Artificial Intelligence (AI) Stock? - The Motley Fool - January 27th, 2025 [January 27th, 2025]
- The Brief: Impact practitioners on the perils and possibilities of artificial intelligence - ImpactAlpha - January 27th, 2025 [January 27th, 2025]
- 3 Mega-Cap Artificial Intelligence (AI) Stocks Wall Street Thinks Will Soar the Most Over the Next 12 Months - sharewise - January 27th, 2025 [January 27th, 2025]
- 3 Mega-Cap Artificial Intelligence (AI) Stocks Wall Street Thinks Will Soar the Most Over the Next 12 Months - The Motley Fool - January 27th, 2025 [January 27th, 2025]
- Ask how you can do human good: artificial intelligence and the future at HKS - Harvard Kennedy School - January 27th, 2025 [January 27th, 2025]
- This Unstoppable Artificial Intelligence (AI) Stock Climbed 90% in 2024, and Its Still a Buy at Todays Price - MSN - January 27th, 2025 [January 27th, 2025]
- Nvidia Plummeted Today -- Time to Buy the Artificial Intelligence (AI) Leader's Stock? - MSN - January 27th, 2025 [January 27th, 2025]
- Artificial intelligence: key updates and developments (20 27 January) - Lexology - January 27th, 2025 [January 27th, 2025]
- Here's 1 Trillion-Dollar Artificial Intelligence (AI) Chip Stock to Buy Hand Over Fist While It's Still a Bargain - The Motley Fool - January 27th, 2025 [January 27th, 2025]
- Artificial intelligence curriculum being questioned as the future of education in Pennsylvania 'cyber charters' - Beaver County Radio - January 27th, 2025 [January 27th, 2025]
- Why Rezolve Could Be the Next Big Name in Artificial Intelligence - MarketBeat - January 27th, 2025 [January 27th, 2025]
- Artificial Intelligence Market to Hit $3819.2 Billion By 2034, US Leading the Way in Artificial Intelligence - EIN News - January 27th, 2025 [January 27th, 2025]
- President Donald Trump Just Announced Project Stargate: 3 Unstoppable Stocks That Could Profit From the Artificial Intelligence (AI) Buildout - The... - January 26th, 2025 [January 26th, 2025]