Search
Close this search box.

IT Leaders Prioritize Generative AI as a Game-Changer, But Concerns Abound

Security and Ethical Issues Present the Most Pressing Worries, According to Salesforce Survey

Generative AI survey from Salesforce

At least 67% of senior IT leaders are making generative AI a priority for their business within the next 18 months, and 33% even name it as a top priority. Yet most leaders have misgivings on the security and ethical aspects of the technology that could ultimately impact its adoption in the coming year, results from a new Salesforce survey of 515 senior IT leaders reveal.

The findings also show that 57% of the leaders believe generative AI is a “game-changer” with the potential to help them better serve their customers, take advantage of data, and operate more efficiently. Even skeptics agree: 80% of those who say generative AI is “overhyped” agree that customers can stand to benefit from the technology.

Generative AI is a category of artificial intelligence algorithms that can be used to create new content like text, images, audio, video, code, and simulations. However, recent new breakthroughs in generative AI have the potential to drastically change the way content can now be created, underscoring not only the technology’s potential but also its security risks and ethical implications.

“Generative AI represents a step change in how organizations across industries will analyze data, automate processes, and empower sales, service, marketing, and commerce professionals to grow customer relationships—but it comes with new risks and challenges,” says Clara Shih, CEO of Service Cloud at Salesforce.

Related Article: Surprise: Enterprise Execs Plan to Increase Digital CX Investments This Year

Among those surveyed, there are concerns that the technology could pose a security risk (79%) and exhibit bias (73%). Moreover, 59% believe that generative AI outputs are inaccurate, and 63% agree there is bias, such as misinformation and hate speech, in its output.

The survey findings indicate that businesses are not yet prepared for successful implementation: 65% of senior IT leaders are unable to justify deploying generative AI at present, and surveyed leaders report major barriers to using generative AI successfully within their organization, with security as the chief issue among those currently using the technology. As a result, 99% believe their businesses must take measures to successfully leverage the technology.

Leaders are also unsure about how to put generative AI ethics into practice, with 30% of businesses believing they must have guidelines on the ethical use of generative AI to successfully implement the technology. Leaders, however, see collaboration as a key tool to ensure the technology is functional and used in an ethical way.

Among senior leaders, 81% believe that generative AI should combine public and private data sources; 82% think businesses should work together to improve the technology’s functionality; and 83% say businesses must align in concert to ensure the ethical use of generative AI.

Author Information

Alex is responsible for writing about trends and changes that are impacting the customer experience market. He had served as Principal Editor at Village Intelligence, a Los Angeles-based consultancy on technology impacting healthcare and healthcare-related industries. Alex was also Associate Director for Content Management at Omdia and Informa Tech, where he produced white papers, executive summaries, market insights, blogs, and other key content assets. His areas of coverage spanned the sectors grouped under the technology vertical, including semiconductors, smart technologies, enterprise & IT, media, displays, mobile, power, healthcare, China research, industrial and IoT, automotive, and transformative technologies.

At IHS Markit, he was Managing Editor of the company’s flagship IHS Quarterly, covering aerospace & defense, economics & country risk, chemicals, oil & gas, and other IHS verticals. He was Principal Editor of analyst output at iSuppli Corp. and Managing Editor of Market Watch, a fortnightly newsletter highlighting significant analyst report findings for pitching to the media. He started his career in writing as an Editor-Reporter for The Associated Press.

SHARE:

Latest Insights:

Sergi Girona, Operations Director at Barcelona Supercomputing Center, and Scott Tease, VP at Lenovo, share insights on enhancing high-performance computing and sustainability through their partnership, highlighting the deployment of MareNostrum 5 with Lenovo's Neptune Water Cooling Technology for environmental efficiency.
Karan Batta, SVP at Oracle, joins Daniel Newman and Patrick Moorhead on the latest episode to share his insights on migrating Oracle Database workloads to AWS, underscoring the pivotal Oracle-AWS partnership.
Seamus Jones, Director at Dell Technologies, shares his insights on Sustainable AI, highlighting Dell's commitment to eco-friendly technology solutions and the role of AI in sustainability.

Latest Research:

In this research brief, Application Modernization: The Catalyst for Mainframe Modernization, completed in partnership with Rocket Software, Futurum dives into how mainframe modernization practices can help enterprises leverage their existing IT assets and make them more agile, cost-effective, and usable long into the future.
The Futurum Group’s latest research report, Redefining AI Hybrid Cloud and Enterprise Workloads with Cooling Innovations, completed in partnership with HPE, explores the issues companies face as data centers scale to accommodate rapidly expanding compute demands, such as AI workloads, liquid cooling is becoming essential, reducing energy costs, minimizing thermal limitations, and enabling more compact and sustainable infrastructure for the next generation of AI advancements.
The Futurum Group’s latest research report, Accelerating AI, Automation, and Innovation in Modern Enterprises, completed in partnership with Red Hat, delves into the technical challenges that organizations are currently navigating. The research highlights how automation, generative AI, and innovative technologies like Red Hat Ansible Automation Platform enable businesses to overcome these obstacles by simplifying complex tasks, optimizing resources, and bridging the skills gap.