Stockholm/San Francisco:

In the early years, getting AI models like ChatGPT or its rival Cohere to spit out human-like responses required vast teams of low-cost workers helping models distinguish basic facts such as if an image was of a car or a carrot. 

But more sophisticated updates to AI models in the fiercely competitive arena are now demanding a rapidly expanding network of human trainers who have specialized knowledge — from historians to scientists, some with doctorate degrees.

“A year ago, we could get away with hiring undergraduates, to just generally teach AI on how to improve,” said Cohere co-founder Ivan Zhang, talking about its internal human trainers.

“Now we have licensed physicians teaching the models how to behave in medical environments, or financial analysts or accountants.”

For more training, Cohere, which was last valued at over $5 billion, works with a startup called Invisible Tech.  Cohere is one of the main rivals of OpenAI and specializes in AI for businesses.

The startup Invisible Tech employs thousands of trainers, working remotely, and has become one of the main partners of AI companies ranging from AI21 to Microsoft to train their AI models to reduce errors, known in the AI world as hallucinations.

“We have 5,000 people in over 100 countries around the world that are PhDs, Master’s degree holders and knowledge work specialists,” said Invisible founder Francis Pedraza.

Invisible pays as much as $40 per hour, depending on the location of the worker and the complexity of work. Some companies such as Outlier pay up to $50 per hour, while another company called Labelbox said it pays up to $200 per hour for “high expertise” subjects like quantum physics, but starts with $15 for basic topics.

Invisible was founded in 2015 as a workflow automation company catering to the likes of food delivery company DoorDash to digitize their delivery menu. But things changed when a relatively unknown research firm called OpenAI contacted them in the spring of 2022, ahead of the public launch of ChatGPT.

“OpenAI came to us with a problem, which is that when you were asking an early version of ChatGPT a question, it was going to hallucinate. You couldn’t trust the answer,” Pedraza told Reuters.

“They needed an advanced AI training partner to provide reinforcement learning with human feedback.”

OpenAI did not respond to request for comment.

Generative AI produces new content based on past data used to train it. However, sometimes it can’t distinguish between true and false information and generates false outputs known as hallucinations. In one notable example, in 2023 a Google chatbot shared inaccurate information about which satellite first took pictures of a planet outside the Earth’s solar system in a promotional video.

AI companies are aware that hallucinations can derail GenAI’s attractiveness to businesses and are trying various ways to reduce it, including using human trainers to teach the concept of fact and fiction.

Since getting onboard with OpenAI, Invisible says it has become AI training partners to most of the GenAI companies, including Cohere, AI21 and Microsoft. Cohere and AI21 confirmed they are clients. Microsoft did not confirm it is a client of Invisible.

“These are all companies that had training challenges, where their number one cost was compute power, and then the number two cost is quality training,” Pedraza said.

HOW DOES IT WORK?

OpenAI, which started off the frenzy around GenAI, has a team of researchers aptly named “Human Data Team” that works with AI trainers to gather specialized data for training its models like ChatGPT.

OpenAI researchers come up with various experiments like reducing hallucinations or to improve writing style and work with AI trainers from Invisible and other vendors, a source familiar with the company’s processes said.

At any point, dozens of experiments are being run, some with tools developed by OpenAI and others by tools of vendors, the person said.

Based on what the AI companies want – from getting better at Swedish history or doing financial modeling – Invisible hires workers with relevant degrees for those projects, reducing the burden of managing hundreds of trainers by the AI companies.

“OpenAI has some of the most incredible computer scientists in the world but they’re not necessarily an expert in Swedish history or chemistry questions or biology questions or anything you can ask it,” Pedraza said, adding that over 1,000 contract workers cater to OpenAI alone.  

Cohere’s Zhang said he has personally used Invisible’s trainers to find a way to teach its GenAI model to find relevant information from a big data set. 

COMPETITION

Among the competitors in this space is Scale AI, a private start-up last valued at $14 billion which provides AI companies with sets of training data. It has also ventured into the area of providing AI trainers, and counts OpenAI as a customer.  Scale AI did not respond to requests for an interview for this story.

Invisible, which has been profitable since 2021, has raised only $8 million of primary capital,  

“We are 70% owned by the team, and only 30% owned by investors,” Pedraza said. “We do facilitate secondary rounds, and the most recent traded price was at a half a billion dollar valuation.” Reuters could not confirm that valuation.

Human trainers first got into AI training through data-labelling work that required less qualification and was also paid less, sometimes as low as $2, mostly done by people in African and Asian countries. 

As AI companies launch more advanced models, the demand for specialized trainers and across dozens of languages is on the rise, creating a well-paid niche where workers from a variety of subjects could become AI trainers without even knowing how to code.

Demand from AI companies is leading to the creation of more companies that are offering similar services.

“My inbox is basically inundated with new firms that pop up here and there. I do see this as a new space where companies hire humans just to create data for AI labs like us,” Zhang said.

(Except for the headline, this story has not been edited by NDTV staff and is published from a syndicated feed.)

Mumbai:

Researchers at the Indian Institute of Technology Bombay (IIT Bombay) have uncovered how animals find their way back home without getting lost or being late by using a robot that mimics their movements.

This robot is designed to move on its own, much like an animal finding food and then to use light as a guide to return home (homing), the IIT Bombay said in a statement on Tuesday.

In a new study, researchers from the department of physics have used this robot to study the underlying principles of homing by animals.

“The primary goal of our research group was to understand the physics of active and living systems. We achieve this by performing experiments on centimetres-sized self-propelled programmable robots. In simple words, we model these robots to mimic the dynamics of living organisms, both at the individual and collective levels,” Dr Nitin Kumar, an assistant professor at the department of physics, IIT Bombay, said.

For their study, the researchers wanted to determine the time it took for the robot to return home, with increasing amounts of deviations from its homing path.

It was observed that the reorientation rate, the frequency at which the robot (or an animal) should adjust its direction for successful homing, originated from the degree of randomness in its path.

The researchers discovered an ‘optimal reorientation rate’ for a particular value of randomness beyond which the adverse effects of increased randomness are negated by more frequent reorientations, ultimately ensuring successful homing.

This suggested animals might have evolved to reorient themselves at an optimal rate to efficiently find their way home, regardless of the noise or unpredictability in their environment.

“The observation of a finite upper limit on return times indicates that the homing motion is inherently efficient. Our results demonstrated that if animals are always aware of the direction of their home and always correct their course whenever they deviate from the intended direction, they will surely get home within a finite time,” Kumar added.

Apart from physical experiments, the researchers also ran computer simulations where the robot’s movement mimicked animals.

This virtual robot combines active Brownian motion (the random motion of particles in a liquid or gas, caused by collisions with fast-moving atoms or molecules in the fluid) with occasional resets to its orientation to correct its course back towards home.

These simulations matched the experimental results, reinforcing the idea that randomness and reorientation work hand-in-hand to optimise homing.

“When we applied this model to the trajectories of a real biological system of a flock of homing pigeons, it showed a good agreement with our theory, validating our hypothesis of enhanced efficiency due to frequent course corrections,” Mr Kumar said.

He said in real and more complex systems, the homing cues might be more complicated than a simple uniform gradient towards home, as modelled in this experiment.

“In our future research, we aim to model these scenarios in our experiment by using a combination of spatiotemporal variations in light intensity and physical obstacles,” the assistant professor added.

(Except for the headline, this story has not been edited by NDTV staff and is published from a syndicated feed.)

Mumbai:

 The Mumbai Police Wednesday registered an FIR against an unnamed person in connection with a deepfake video of actor Aamir Khan in which he was seen promoting a political party, official here said.

The FIR was filed at the Khar Police station by Mr Khan’s office under relevant sections of the Indian Penal Code (IPC), including 419 (impersonation), 420 (cheating) and other sections of the Information Technology Act.

In the purported 27-second clip, which seems to have been edited using artificial intelligence (AI), Mr Khan could be seen talking about staying away from rhetoric (jumla).

A spokesperson for the actor had said on Tuesday that while Mr Khan has in the past raised awareness through Election Commission campaigns through the years, he never promoted any political party.

The disputed deepfake video inserts Mr Khan into a scene from a decade-old episode of his television show, ‘Satyamev Jayate’.

“We want to clarify that Mr Aamir Khan has never endorsed any political party throughout his 35-year career. He has dedicated his efforts to raising awareness through Election Commission public awareness campaigns for many past elections,” Mr Khan’s spokesperson had said in a statement.

“We are alarmed by the recent viral video alleging that Aamir Khan is promoting a particular political party. He would like to clarify that this is a fake video and totally untrue. He has reported the matter to various authorities related to this issue, including filing an FIR with the Cyber Crime Cell of the Mumbai Police,” Mr Khan’s spokesperson said in a statement.

(Except for the headline, this story has not been edited by NDTV staff and is published from a syndicated feed.)

New Delhi:

Microsoft has warned that China is gearing up to disrupt the upcoming elections in India, the United States and South Korea by using artificial intelligence-generated content. The warning comes after China conducted a trial run during Taiwan’s presidential election, employing AI to influence the outcome.

Across the world, at least 64 countries, in addition to the European Union, are expected to hold national elections. These countries collectively account for approximately 49 per cent of the global population.

According to Microsoft’s threat intelligence team, Chinese state-backed cyber groups, along with involvement from North Korea, are expected to target several elections scheduled for 2024. Microsoft said that China will likely deploy AI-generated content via social media to sway public opinion in favour of their interests during these elections.

“With major elections taking place around the world this year, particularly in India, South Korea and the United States, we assess that China will, at a minimum, create and amplify AI-generated content to benefit its interests,” Microsoft said in its statement.

Threat Of AI In Elections

The threat posed by political advertisements employing AI technology to produce deceptive and false content, including “deepfakes” or fabricating events that never took place, is significant in a crucial poll year. Such tactics aim to mislead the public regarding candidates’ statements, stances on various issues, and even the authenticity of certain events. If allowed to go unchecked, these manipulative attempts have the potential to undermine voters’ ability to make well-informed decisions.

While the immediate impact of AI-generated content remains relatively low, Microsoft warned that China’s increasing experimentation with this technology could potentially become more effective over time. The tech giant noted that China’s previous attempt to influence Taiwan’s election involved the dissemination of AI-generated disinformation, marking the first instance of a state-backed entity utilising such tactics in a foreign election.

During the Taiwanese election, a Beijing-backed group known as Storm 1376, or Spamouflage, was notably active, Microsoft said. This group circulated AI-generated content, including fake audio endorsements and memes, aimed at discrediting certain candidates and influencing voter perceptions. The use of AI-generated TV news anchors, is a tactic also employed by Iran.

“Storm-1376 has promoted a series of AI-generated memes of Taiwan’s then-Democratic Progressive Party (DPP) presidential candidate William Lai, and other Taiwanese officials as well as Chinese dissidents around the world. These have included an increasing use of AI-generated TV news anchors that Storm-1376 has deployed since at least February 2023,” Microsoft said.

AI Influence In US Affairs

Microsoft pointed out that Chinese groups continue to conduct influence campaigns in the United States, leveraging social media platforms to pose divisive questions and gather intelligence on key voting demographics.

“There has been an increased use of Chinese AI-generated content in recent months, attempting to influence and sow division in the US and elsewhere on a range of topics including the train derailment in Kentucky in November 2023, the Maui wildfires in August 2023, the disposal of Japanese nuclear wastewater, drug use in the US as well as immigration policies and racial tensions in the country. There is little evidence these efforts have been successful in swaying opinion,” Microsoft stated.

The use of AI in US election campaigns is not new. In the lead-up to the 2024 New Hampshire Democratic primaries, an AI-generated phone call mimicked President Joe Biden’s voice, advising voters against participating in the polling.

The call falsely insinuated that voters should withhold their votes for the general election in November instead. Upon hearing this message, the average voter could easily have been misled into believing that President Biden himself had endorsed this directive, potentially leading to their disenfranchisement.

Although there is no evidence of Chinese involvement in the New Hampshire episode, the incident marks one of many such instances where AI posed a direct threat to democratic practices.

Road Ahead For India

India’s general elections are scheduled to begin on April 19, with the results set to be declared on June 4. The electoral process will unfold across seven phases, with the first phase commencing on April 19, followed by the second phase on April 26, the third phase on May 7, the fourth phase on May 13, the fifth phase on May 20, the sixth phase on May 25, and culminating with the seventh phase on June 1.

The current term of the 17th Lok Sabha Assembly is set to conclude on June 16.

The Election Commission of India (ECI) has already provided guidelines and protocols for promptly identifying and responding to false information and misinformation.

Last month, representatives from OpenAI, the developer of ChatGPT, met with members of the ICI and delivered a presentation to the commission members outlining the measures being undertaken to prevent the misuse of AI in the upcoming elections.

New Delhi:

Microsoft has warned that China is gearing up to disrupt the upcoming elections in India, the United States and South Korea by using artificial intelligence-generated content. The warning comes after China conducted a trial run during Taiwan’s presidential election, employing AI to influence the outcome.

Across the world, at least 64 countries, in addition to the European Union, are expected to hold national elections. These countries collectively account for approximately 49 per cent of the global population.

According to Microsoft’s threat intelligence team, Chinese state-backed cyber groups, along with involvement from North Korea, are expected to target several elections scheduled for 2024. Microsoft said that China will likely deploy AI-generated content via social media to sway public opinion in favour of their interests during these elections.

“With major elections taking place around the world this year, particularly in India, South Korea and the United States, we assess that China will, at a minimum, create and amplify AI-generated content to benefit its interests,” Microsoft said in its statement.

Threat Of AI In Elections

The threat posed by political advertisements employing AI technology to produce deceptive and false content, including “deepfakes” or fabricating events that never took place, is significant in a crucial poll year. Such tactics aim to mislead the public regarding candidates’ statements, stances on various issues, and even the authenticity of certain events. If allowed to go unchecked, these manipulative attempts have the potential to undermine voters’ ability to make well-informed decisions.

While the immediate impact of AI-generated content remains relatively low, Microsoft warned that China’s increasing experimentation with this technology could potentially become more effective over time. The tech giant noted that China’s previous attempt to influence Taiwan’s election involved the dissemination of AI-generated disinformation, marking the first instance of a state-backed entity utilising such tactics in a foreign election.

During the Taiwanese election, a Beijing-backed group known as Storm 1376, or Spamouflage, was notably active, Microsoft said. This group circulated AI-generated content, including fake audio endorsements and memes, aimed at discrediting certain candidates and influencing voter perceptions. The use of AI-generated TV news anchors, is a tactic also employed by Iran.

“Storm-1376 has promoted a series of AI-generated memes of Taiwan’s then-Democratic Progressive Party (DPP) presidential candidate William Lai, and other Taiwanese officials as well as Chinese dissidents around the world. These have included an increasing use of AI-generated TV news anchors that Storm-1376 has deployed since at least February 2023,” Microsoft said.

AI Influence In US Affairs

Microsoft pointed out that Chinese groups continue to conduct influence campaigns in the United States, leveraging social media platforms to pose divisive questions and gather intelligence on key voting demographics.

“There has been an increased use of Chinese AI-generated content in recent months, attempting to influence and sow division in the US and elsewhere on a range of topics including the train derailment in Kentucky in November 2023, the Maui wildfires in August 2023, the disposal of Japanese nuclear wastewater, drug use in the US as well as immigration policies and racial tensions in the country. There is little evidence these efforts have been successful in swaying opinion,” Microsoft stated.

The use of AI in US election campaigns is not new. In the lead-up to the 2024 New Hampshire Democratic primaries, an AI-generated phone call mimicked President Joe Biden’s voice, advising voters against participating in the polling.

The call falsely insinuated that voters should withhold their votes for the general election in November instead. Upon hearing this message, the average voter could easily have been misled into believing that President Biden himself had endorsed this directive, potentially leading to their disenfranchisement.

Although there is no evidence of Chinese involvement in the New Hampshire episode, the incident marks one of many such instances where AI posed a direct threat to democratic practices.

Road Ahead For India

India’s general elections are scheduled to begin on April 19, with the results set to be declared on June 4. The electoral process will unfold across seven phases, with the first phase commencing on April 19, followed by the second phase on April 26, the third phase on May 7, the fourth phase on May 13, the fifth phase on May 20, the sixth phase on May 25, and culminating with the seventh phase on June 1.

The current term of the 17th Lok Sabha Assembly is set to conclude on June 16.

The Election Commission of India (ECI) has already provided guidelines and protocols for promptly identifying and responding to false information and misinformation.

Last month, representatives from OpenAI, the developer of ChatGPT, met with members of the ICI and delivered a presentation to the commission members outlining the measures being undertaken to prevent the misuse of AI in the upcoming elections.

As generative AI systems like OpenAI’s ChatGPT and Google’s Gemini become more advanced, researchers are now developing AI worms which can steal your confidential data and break security measures of the generative AI systems, as per a report in Wired.

Researchers from Cornell University, Technion-Israel Institute of Technology, and Intuit created the first generative AI worm called ‘Morris II’ which can steal data or deploy malware and spread from one system to another. It has been named after the first worm which was launched on the internet in 1988. Ben Nassi, a Cornell Tech researcher, said, “It basically means that now you have the ability to conduct or to perform a new kind of cyberattack that hasn’t been seen before,”

The AI worm can breach some security measures in ChatGPT and Gemini by attacking a generative AI email assistant with the intent of stealing email data and sending spam, as per the outlet.

The researchers used an “adversarial self-replicating prompt” to develop the generative AI worm. According to them, this prompt causes the generative AI model to generate a different prompt in response. To execute it, the researchers then created an email system that could send and receive messages using generative AI, adding into ChatGPT, Gemini, and open-source LLM. Further, they discovered two ways to utilise the system- by using a self-replicating prompt that was text-based and by embedding the question within an image file.

In one case, the researchers took on the role of attackers and sent an email with an adversarial text prompt. This “poisons” the email assistant’s database by utilising retrieval-augmented generation, which allows LLMs to get more data from outside their system. According to Mr Nassi, the retrieval-augmented generation “jailbreaks the GenAI service” when it retrieves an email in response to a user inquiry and sends it to GPT-4 or Gemini Pro to generate a response. This eventually results in the theft of data from the emails.

“The generated response containing the sensitive user data later infects new hosts when it is used to reply to an email sent to a new client and then stored in the database of the new client,” he added.

For the second method, the researcher mentioned, “By encoding the self-replicating prompt into the image, any kind of image containing spam, abuse material, or even propaganda can be forwarded further to new clients after the initial email has been sent.”

A video showcasing the findings shows the email system repeatedly forwarding a message. The researchers claim that they could also obtain email data.”It can be names, it can be telephone numbers, credit card numbers, SSN, anything that is considered confidential,” Mr Nassi said.

The researchers also warned about “bad architecture design” within the AI system. They also reported their observations to Google and OpenAI. “They appear to have found a way to exploit prompt-injection type vulnerabilities by relying on user input that hasn’t been checked or filtered,” a spokesperson for OpenAI told the outlet. Further, they mentioned that they are working to make systems “more resilient” and developers should “use methods that ensure they are not working with harmful input.” 

Google declined to comment on the subject.

London:

Tesla CEO and ‘X’ owner, Elon Musk said on Wednesday that Artificial Intelligence (AI) could endanger the existence of human civilisation.

“There is some chance, above zero, that AI will kill us all. I think it’s slow but there is some chance. I think this also concerns the fragility of human civilization. If you study history, you will realise that every civilisation has a sort of lifespan,” he said.

His remarks came during a media interaction as he arrived to attend the United Kingdom hosted world’s first global Artificial Intelligence (AI) Safety Summit.

Moreover, Musk was also seen having conversations with some of the participants at the summit.

Earlier, a day before attending the AI summit, Musk appeared on comedian Joe Rogan’s podcast, in which he that artificial intelligence (AI), if programmed by people in the “environmental movement”, may lead to the extinction of humanity.

In the podcast, he said, “Actually, what I think the biggest danger is for AI is that if AI is implicitly programmed, I don’t think they explicitly but implicitly programmed with values that led to the destruction of downtown San Francisco. And a bunch of these AI companies are in San Francisco or in the San Francisco Bay Area. Then you could implicitly program an AI to believe that extinction of humanity is what it should try to do.”

He added, “I think the most likely outcome to be specific about it is a good outcome, most likely a good outcome. But it’s not for sure. So i think we’re to be careful how we program the eye and make sure that it is not accidentally antihuman.”

Moreover, the social media company Meta President said, “I’m looking forward to attending the AI Safety Summit in the UK this week. I hope we spend as much time as possible developing much-needed solutions to current problems – for example, on the transparency and detectability of AI-generated content.”

He added, “not just debating speculative future risks about AI models that currently do not exist, and may never possess the autonomy and agency that some people fear.”

The summit underway in UK will see a convergence of governments, academia and companies working in artificial intelligence to debate and identify risks, opportunities and the “need for international collaboration, before highlighting consensus on the scale, importance and urgency for AI opportunities” a statement by the British High Commission read.

Moreover, British Prime Minister Rishi Sunak has said that he will do a live conversation with Elon Musk on X after the AI summit.

PM Sunak posted on X, “In conversation with @elonmusk. After the AI Safety Summit, Thursday night on @x.”

The summit aims to put light on the transformative benefits that AI technology can offer, putting a predominant focus on “education and areas for international research collaborations”.

Representatives from The Alan Turing Institute, The Organisation for Economic Cooperation and Development (OECD) and the Ada Lovelace Institute are also among the groups confirmed to attend.

Prime Minister Sunak had last week stated that the summit will focus on understanding the risks such as potential threats to national security including the dangers a loss of control the technology could bring.

On the agenda are discussions around issues likely to impact society, such as election disruption and erosion of social trust.

According to government estimates, the UK already employs over 50,000 people in the AI sector and contributes 3.7 billion pounds to its economy annually. Michelle Donelan will be joined by members of the UK’s Frontier AI Taskforce – including its Chair, Ian Hogarth. The task force was launched earlier this year with an aim to evaluate the risks of frontier AI models (generative language models of AI).

Additionally, on the first day of the Summit, Union Minister of State Rajeev Chandrasekhar participated the AI summit and conveyed India’s thoughts on AI.

On the second day of the summit, Chandrasekhar will contribute to discussions regarding the establishment of a collaborative framework for AI among like-minded nations. He will shed light on India’s perspective concerning AI risks in areas such as disinformation and electoral security.

(Except for the headline, this story has not been edited by NDTV staff and is published from a syndicated feed.)