Still waiting for OpenAI plugins?

Still waiting for OpenAI plugins? No need to wait anymore when OpenBMB’s open source BM Tools are here! | by OpenBMB | Medium

Sign up

Get app

Sign up

Still waiting for OpenAI plugins? No need to wait anymore when OpenBMB’s open source BM Tools are here!

4 min read

Apr 10, 2023

--

Share

On March 23, 2023, OpenAI announced the launch of the Plugins system, further enhancing ChatGPT’s powerful capabilities by support ChatGPT to connect to external tools such as browsers and mathematical calculations. These features have definitely been exciting and intriguing for developers, but they are not publicly yet available. When they eagerly click on the Plugins page, all they can do is merely fill out a “waitlist” and then be added to the end of the long waiting list.

OpenBMB is dedicated to developing efficient calculation tools for large-scale models, and the team has been researching tool learning technologies since 2022. To meet the eager expectations of many developers for OpenAI Plugins, OpenBMB has decided to open source the big model tool learning engine — — BMTools, which not only supports OpenAI Plugins but also allows customization for more tools, letting the users to quickly experience the tool learning capabilities of big models.

OpenAI Plugins Have Caused A Stir

OpenAI Plugins allow ChatGPT to use developer-defined APIs to perform a wide range of tasks in various scenarios. With the support of OpenAI Plugins, ChatGPT can access the latest information, perform calculations, and use third-party services. Currently, it already supports features such as Expedia (hotel and travel booking), KAYAK (flight booking and car rental), Klarna Shopping (price comparison), OpenTable (restaurant booking), and Wolfram (computation and real-time data). Basically, developers can use ChatGPT to call their own interfaces to achieve specific functions.

The OpenBMB team calls the ability of big models to master external tools “Tool Learning,” and the organic combination of big models and external tools successfully makes up for many shortcomings of previous capabilities. Since 2022, the OpenBMB team has continued to research new paradigms for tool learning, attempting to combine existing language models with search engines, knowledge bases, and other tools, achieving good experimental results. The OpenBMB team has also made productive explorations in the forefront of tool learning research.

Based on this, the team has toolified the relevant research results, and organized them into a tool package called BMTools, embedding the tool learning paradigm into the capability system of large-scale models, and officially joining the OpenBMB big model tool system “full house”.

BMTools: A Big Model Tool Learning Engine

Support tools: OpenAI Plugins + Customized Tools

BMTools supports OpenAI’s Plugins, and also allows developers to add their own tool lists. BM Tools currently supports the integration of OpenAI’s ChatGPT and GPT4 models and provides the corresponding implementation of OpenAI Plugins. At the same time, through BMTools, developers can customize appropriate tools to the list according to their own needs, improving the efficiency and quality of specific development.

Offering Help In : Code + Front-end Display Page

BMTools not only provides a concise interface for converting user-provided Python functions into OpenAI plugins, but also provides a locally-based tool learning framework based on the thinking-action chain, guiding the model to the procedures and scenarios of tool learning. In addition, BMTools also comes with corresponding front-end display pages, which allow developers to intuitively see the model output and facilitate users to directly experience the tool usage effect from the web page. Therefore, BMTools is definitely a powerful tool for AI development, which can help developers to develop and apply AI more efficiently and accurately.

Get OpenBMB’s stories in your inbox

Join Medium for free to get updates from this writer.

Subscribe

Subscribe

Remember me for faster sign in

For example, we input a query case like, “What is the distance between New York and London? How is the weather in London?” The model can correctly allocate WolframAlpha among the selected three tools to query geographical knowledge, and Weather to predict the weather, and give detailed answers, including a roadmap from New York to London.

Advancing Further, Promising Future for BMTools

The OpenBMB team has been dedicated to providing easy-to-use open source toolkits for big models, hoping to achieve “bringing big models into every household.” BMTools is our latest toolkit, which is practical though not perfect yet. In the future, we will focus on continuous optimization and updating in the following three aspects:

• On the one hand, we are committed to supporting more tools to meet different development needs. We will continue to develop and integrate the most advanced tools, and we definitely welcome contributions from the open source community!
• On the other hand, we will continue to support more open source big models to meet the needs in different scenarios.
• Finally, we will also focus on supporting dialogues to help users use big models and related tools with better interactive methods.

Many hands make light work. We sincerely welcome friends from the OpenBMB open source community to contribute their wisdom in improving BMTools. We believe that BMTools will become a heavyweight weapon in the field of big model development, helping developers to create rich and wonderful AI applications and products efficiently and conveniently.

Links:

Written by OpenBMB

OpenBMB, known as Open Lab for Big Model Base, aims to build a large-scale pre-trained language model library and related tools

No responses yet

More from OpenBMB

·

Nov 17, 2022

OpenBMB: Big Models for Everyone

In recent years, as the pre-trained language model technology has triggered a performance revolution in artificial intelligence, maturity…

·

Nov 16, 2023

ModelBest Adopts the LLM-Based AI Agents to Launch ChatDev, its First SaaS Product

Breaking news! Here comes an AI-native app developed using the LLM-based AI agents.

·

Jul 15, 2023

Speak and draw! VisCPM：SOTA Open-source Chinese Multimodal Large Model

VisCPM is a series of open-source large multimodal models, supporting multimodal conversational and and text-to-image generation…

·

Jun 17, 2023

##…