Kong Beats Chest To Ward Off Bad AI Connections
Kong’s AI Gateway is designed to help reduce AI hallucinations and improve AI governance through a range of new features. This technology aims to enhance the accuracy and reliability of AI systems by mitigating the risk of hallucinations. By implementing these features, Kong is striving to provide a safer and more trustworthy AI environment for users and organizations. This development highlights the growing importance of ethical considerations and responsible AI practices in the field of artificial intelligence.
MELBOURNE, AUSTRALIA - MAY 27: In this handout image provided by Global Creatures, King Kong ... More performs on stage during a "King Kong" Production media call at the Regent Theatre on May 27, 2013 in Melbourne, Australia. (Photo by James Morgan/Global Creatures via Getty Images)
Interconnectivity in Software
Interconnectivity enriches software. Beyond mere networking designed to connect one user to another, or one user to a database or some other technology service, the act of interconnectivity at the application code (and lower kernel) level is carried out to create software functions that are greater than the sum of their parts.
Very often executed via the use of an application programming interface, APIs exist to weave together one application to another, one application to a smaller component service, to form a connection to a smaller containerized piece of algorithmic logic, or to forge a bond upwards to a higher-level operating system.
Kong AI Gateway
Because we are now so focused on where artificial intelligence models connect with data resources, it’s logical enough to see cloud API company Kong Inc. now extend its technology designed to corral and manage the connectivity neurons that are sparking off across AI topographies and architectures.
Kong AI Gateway is focused on AI connections and acts as a gateway manager to decide what should or shouldn’t connect with what and deliver AI security and governance guardrails.
Key Features
Updates to this technology include automated retrieval-augmented generation “pipelines” aimed at preventing large language model hallucinations from manifesting themselves inside new agentic AI functions.
Kong’s product is also able to manage personally identifiable information sanitization with its PII plugin, which enables the sanitization and protection of personal data, passwords, and codes across 18 different human languages and across all AI providers.
Statement from Marco Palladino
“As artificial intelligence continues to evolve, organisations must adopt robust AI infrastructure to harness its full potential,” said Marco Palladino, CTO and co-founder, Kong Inc.
“With this latest version of Kong AI Gateway, we’re equipping our customers with the tools necessary to implement agentic AI securely and effectively, ensuring integration without compromising user experience. Moreover, we’re helping solve some of the big challenges with LLMs, such as cutting down on hallucinations and improving data security and governance.
Automated RAG Pipelines
The new automated RAG pipelines feature helps a key LLM challenge, their tendency to hallucinate and provide less than accurate or wildly inaccurate response and results. Kong says that AI Gateway 3.10 will automatically query a vector database to insert relevant data to a prompt as it goes, ensuring the LLM is pulling from a consistent, reliable, and up-to-date knowledge source.
Improved Security and Compliance
The improved security and compliance functions now on offer give software engineering teams more control in terms of their ability to consistently improve LLM response accuracy and reduce hallucinations as systems grow bigger and the responsibility to “scale” technologies starts to loom.
Native PII Sanitization
Native PII sanitization means software developers can sanitize and protect personal data, passwords, and codes. This update will enable technology stakeholders to enforce PII sanitization at a global platform level and remove the need for manual coding.
HONESTAI ANALYSIS
The modern networking engineer now has a lot to think about with the extended responsibilities in managing APIs, their connections, and addressing AI challenges. Kong’s core service offering aims to circumvent and avoid these complexities, providing a robust solution for interconnectivity in IT stacks.