 Help me find similarity scores for different restaurant reviews.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Sentence Similarity\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Sentence Transformers\', \'api_name\': \'flax-sentence-embeddings/all_datasets_v4_MiniLM-L6\', \'api_call\': "SentenceTransformer(\'flax-sentence-embeddings/all_datasets_v4_MiniLM-L6\')", \'api_arguments\': \'text\', \'python_environment_requirements\': \'sentence-transformers library\', \'example_code\': "from sentence_transformers import SentenceTransformer\\nmodel = SentenceTransformer(\'flax-sentence-embeddings/all_datasets_v4_MiniLM-L6\')\\ntext = Replace me by any text you\'d like.\\ntext_embbedding = model.encode(text)", \'performance\': {\'dataset\': \'1,097,953,922\', \'accuracy\': \'N/A\'}, \'description\': \'The model is trained on very large sentence level datasets using a self-supervised contrastive learning objective. It is fine-tuned on a 1B sentence pairs dataset, and it aims to capture the semantic information of input sentences. The sentence vector can be used for information retrieval, clustering, or sentence similarity tasks.\'}', metadata={})]


 Our company is building an automated assistance system for the visually impaired. We need a tool to convert text into spoken instructions.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Audio Text-to-Speech\', \'framework\': \'ESPnet\', \'functionality\': \'Text-to-Speech\', \'api_name\': \'kan-bayashi_jvs_tts_finetune_jvs001_jsut_vits_raw_phn_jaconv_pyopenjta-truncated-178804\', \'api_call\': "AutoModelForCausalLM.from_pretrained(\'espnet/kan-bayashi_jvs_tts_finetune_jvs001_jsut_vits_raw_phn_jaconv_pyopenjta-truncated-178804\')", \'api_arguments\': \'text\', \'python_environment_requirements\': \'transformers\', \'example_code\': \'\', \'performance\': {\'dataset\': \'\', \'accuracy\': \'\'}, \'description\': \'A Japanese text-to-speech model trained using the ESPnet framework. It is designed to convert text input into natural-sounding speech.\'}', metadata={})]


 I would like to create an application where users may listen to translations of English sentences. I need a Text-to-Speech model to support this functionality.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Text2Text Generation\', \'framework\': \'Transformers\', \'functionality\': \'Sentence Correction\', \'api_name\': \'flexudy/t5-base-multi-sentence-doctor\', \'api_call\': "AutoModelWithLMHead.from_pretrained(\'flexudy/t5-base-multi-sentence-doctor\')", \'api_arguments\': [\'input_text\'], \'python_environment_requirements\': [\'transformers\'], \'example_code\': \'from transformers import AutoTokenizer, AutoModelWithLMHead\\ntokenizer = AutoTokenizer.from_pretrained(flexudy/t5-base-multi-sentence-doctor)\\nmodel = AutoModelWithLMHead.from_pretrained(flexudy/t5-base-multi-sentence-doctor)\\ninput_text = repair_sentence: m a medical doct context: {That is my job I a}{or I save lives} </s>\\ninput_ids = tokenizer.encode(input_text, return_tensors=pt)\\noutputs = model.generate(input_ids, max_length=32, num_beams=1)\\nsentence = tokenizer.decode(outputs[0], skip_special_tokens=True, clean_up_tokenization_spaces=True)\\nassert sentence == I am a medical doctor.\', \'performance\': {\'dataset\': \'tatoeba\', \'accuracy\': \'Not specified\'}, \'description\': \'Sentence doctor is a T5 model that attempts to correct the errors or mistakes found in sentences. Model works on English, German and French text.\'}', metadata={})]


 We are a language learning app platform. We need a text-to-speech tool to read a sentence in multiple languages for our users.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Conversational\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Transformers\', \'api_name\': \'hyunwoongko/blenderbot-9B\', \'api_call\': "pipeline(\'conversational\', model=\'hyunwoongko/blenderbot-9B\')", \'api_arguments\': \'text\', \'python_environment_requirements\': \'transformers\', \'example_code\': \'Input a message to start chatting with hyunwoongko/blenderbot-9B.\', \'performance\': {\'dataset\': \'blended_skill_talk\', \'accuracy\': \'Not provided\'}, \'description\': \'Building open-domain chatbots is a challenging area for machine learning research. While prior work has shown that scaling neural models in the number of parameters and the size of the data they are trained on gives improved results, we show that other ingredients are important for a high-performing chatbot. Good conversation requires a number of skills that an expert conversationalist blends in a seamless way: providing engaging talking points and listening to their partners, both asking and answering questions, and displaying knowledge, empathy and personality appropriately, depending on the situation. We show that large scale models can learn these skills when given appropriate training data and choice of generation strategy. We build variants of these recipes with 90M, 2.7B and 9.4B parameter neural models, and make our models and code publicly available. Human evaluations show our best models are superior to existing approaches in multi-turn dialogue in terms of engagingness and humanness measurements. We then discuss the limitations of this work by analyzing failure cases of our models.\'}', metadata={})]


 I need to create an audio output that translates the given text to speech for a French audiobook assistant.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Translation\', \'framework\': \'Hugging Face\', \'functionality\': \'Translation\', \'api_name\': \'Helsinki-NLP/opus-mt-en-fr\', \'api_call\': "translate(\'input_text\', model=\'Helsinki-NLP/opus-mt-en-fr\')", \'api_arguments\': [\'input_text\'], \'python_environment_requirements\': [\'transformers\'], \'example_code\': \'\', \'performance\': {\'dataset\': \'opus\', \'accuracy\': {\'BLEU\': {\'newsdiscussdev2015-enfr.en.fr\': 33.8, \'newsdiscusstest2015-enfr.en.fr\': 40.0, \'newssyscomb2009.en.fr\': 29.8, \'news-test2008.en.fr\': 27.5, \'newstest2009.en.fr\': 29.4, \'newstest2010.en.fr\': 32.7, \'newstest2011.en.fr\': 34.3, \'newstest2012.en.fr\': 31.8, \'newstest2013.en.fr\': 33.2, \'Tatoeba.en.fr\': 50.5}}}, \'description\': \'Helsinki-NLP/opus-mt-en-fr is a translation model that translates English text to French using the Hugging Face Transformers library. It is based on the OPUS dataset and uses a transformer-align architecture with normalization and SentencePiece pre-processing.\'}', metadata={})]


 We are opening a platform where users can record their own podcast and host it on our platform, can you help us to convert the audio into text automatically?\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Conversational\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Transformers\', \'api_name\': \'hyunwoongko/blenderbot-9B\', \'api_call\': "pipeline(\'conversational\', model=\'hyunwoongko/blenderbot-9B\')", \'api_arguments\': \'text\', \'python_environment_requirements\': \'transformers\', \'example_code\': \'Input a message to start chatting with hyunwoongko/blenderbot-9B.\', \'performance\': {\'dataset\': \'blended_skill_talk\', \'accuracy\': \'Not provided\'}, \'description\': \'Building open-domain chatbots is a challenging area for machine learning research. While prior work has shown that scaling neural models in the number of parameters and the size of the data they are trained on gives improved results, we show that other ingredients are important for a high-performing chatbot. Good conversation requires a number of skills that an expert conversationalist blends in a seamless way: providing engaging talking points and listening to their partners, both asking and answering questions, and displaying knowledge, empathy and personality appropriately, depending on the situation. We show that large scale models can learn these skills when given appropriate training data and choice of generation strategy. We build variants of these recipes with 90M, 2.7B and 9.4B parameter neural models, and make our models and code publicly available. Human evaluations show our best models are superior to existing approaches in multi-turn dialogue in terms of engagingness and humanness measurements. We then discuss the limitations of this work by analyzing failure cases of our models.\'}', metadata={})]


 We are currently working on the development of a speech-to-text application for transcription purposes. Can you help generate the required transcription code?\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Computer Vision Video Classification\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Video Classification\', \'api_name\': \'videomae-small-finetuned-ssv2\', \'api_call\': "VideoMAEForVideoClassification.from_pretrained(\'MCG-NJU/videomae-small-finetuned-ssv2\')", \'api_arguments\': {\'model_name\': \'MCG-NJU/videomae-small-finetuned-ssv2\'}, \'python_environment_requirements\': {\'transformers\': \'from transformers import VideoMAEFeatureExtractor, VideoMAEForVideoClassification\', \'numpy\': \'import numpy as np\', \'torch\': \'import torch\'}, \'example_code\': \'video = list(np.random.randn(16, 3, 224, 224))\\nfeature_extractor = VideoMAEFeatureExtractor.from_pretrained(MCG-NJU/videomae-small-finetuned-ssv2)\\nmodel = VideoMAEForVideoClassification.from_pretrained(MCG-NJU/videomae-small-finetuned-ssv2)\\ninputs = feature_extractor(video, return_tensors=pt)\\nwith torch.no_grad():\\n  outputs = model(**inputs)\\n  logits = outputs.logits\\npredicted_class_idx = logits.argmax(-1).item()\\nprint(Predicted class:, model.config.id2label[predicted_class_idx])\', \'performance\': {\'dataset\': \'Something-Something V2\', \'accuracy\': {\'top-1\': 66.8, \'top-5\': 90.3}}, \'description\': \'VideoMAE is an extension of Masked Autoencoders (MAE) to video. The architecture of the model is very similar to that of a standard Vision Transformer (ViT), with a decoder on top for predicting pixel values for masked patches. Videos are presented to the model as a sequence of fixed-size patches (resolution 16x16), which are linearly embedded. One also adds a [CLS] token to the beginning of a sequence to use it for classification tasks. One also adds fixed sinus/cosinus position embeddings before feeding the sequence to the layers of the Transformer encoder. By pre-training the model, it learns an inner representation of videos that can then be used to extract features useful for downstream tasks: if you have a dataset of labeled videos for instance, you can train a standard classifier by placing a linear layer on top of the pre-trained encoder. One typically places a linear layer on top of the [CLS] token, as the last hidden state of this token can be seen as a representation of an entire video.\'}', metadata={})]


 We are building an app for tour guides to transcribe what they say during the tour. Then the transcript will be translated into sign language.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Conversational\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Transformers\', \'api_name\': \'hyunwoongko/blenderbot-9B\', \'api_call\': "pipeline(\'conversational\', model=\'hyunwoongko/blenderbot-9B\')", \'api_arguments\': \'text\', \'python_environment_requirements\': \'transformers\', \'example_code\': \'Input a message to start chatting with hyunwoongko/blenderbot-9B.\', \'performance\': {\'dataset\': \'blended_skill_talk\', \'accuracy\': \'Not provided\'}, \'description\': \'Building open-domain chatbots is a challenging area for machine learning research. While prior work has shown that scaling neural models in the number of parameters and the size of the data they are trained on gives improved results, we show that other ingredients are important for a high-performing chatbot. Good conversation requires a number of skills that an expert conversationalist blends in a seamless way: providing engaging talking points and listening to their partners, both asking and answering questions, and displaying knowledge, empathy and personality appropriately, depending on the situation. We show that large scale models can learn these skills when given appropriate training data and choice of generation strategy. We build variants of these recipes with 90M, 2.7B and 9.4B parameter neural models, and make our models and code publicly available. Human evaluations show our best models are superior to existing approaches in multi-turn dialogue in terms of engagingness and humanness measurements. We then discuss the limitations of this work by analyzing failure cases of our models.\'}', metadata={})]


 I am an English teacher. I have recently met a Hokkien speaker. I am looking to translate a conversational sentence from English to Hokkien to facilitate communication.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Text2Text Generation\', \'framework\': \'Transformers\', \'functionality\': \'Sentence Correction\', \'api_name\': \'flexudy/t5-base-multi-sentence-doctor\', \'api_call\': "AutoModelWithLMHead.from_pretrained(\'flexudy/t5-base-multi-sentence-doctor\')", \'api_arguments\': [\'input_text\'], \'python_environment_requirements\': [\'transformers\'], \'example_code\': \'from transformers import AutoTokenizer, AutoModelWithLMHead\\ntokenizer = AutoTokenizer.from_pretrained(flexudy/t5-base-multi-sentence-doctor)\\nmodel = AutoModelWithLMHead.from_pretrained(flexudy/t5-base-multi-sentence-doctor)\\ninput_text = repair_sentence: m a medical doct context: {That is my job I a}{or I save lives} </s>\\ninput_ids = tokenizer.encode(input_text, return_tensors=pt)\\noutputs = model.generate(input_ids, max_length=32, num_beams=1)\\nsentence = tokenizer.decode(outputs[0], skip_special_tokens=True, clean_up_tokenization_spaces=True)\\nassert sentence == I am a medical doctor.\', \'performance\': {\'dataset\': \'tatoeba\', \'accuracy\': \'Not specified\'}, \'description\': \'Sentence doctor is a T5 model that attempts to correct the errors or mistakes found in sentences. Model works on English, German and French text.\'}', metadata={})]


 Determine the keyword spoken in a recorded audio file.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Audio Automatic Speech Recognition\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Feature Extraction\', \'api_name\': \'microsoft/wavlm-large\', \'api_call\': "Wav2Vec2Model.from_pretrained(\'microsoft/wavlm-large\')", \'api_arguments\': \'speech input\', \'python_environment_requirements\': \'transformers\', \'example_code\': \'To fine-tune the model for speech recognition, see the official speech recognition example. To fine-tune the model for speech classification, see the official audio classification example.\', \'performance\': {\'dataset\': \'SUPERB benchmark\', \'accuracy\': \'state-of-the-art performance\'}, \'description\': \'WavLM-Large is a large model pretrained on 16kHz sampled speech audio. It is built based on the HuBERT framework, with an emphasis on both spoken content modeling and speaker identity preservation. WavLM is pretrained on 60,000 hours of Libri-Light, 10,000 hours of GigaSpeech, and 24,000 hours of VoxPopuli. It achieves state-of-the-art performance on the SUPERB benchmark and brings significant improvements for various speech processing tasks on their representative benchmarks.\'}', metadata={})]


 Determine which speaker an audio segment belongs to using the provided audio file.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Audio Automatic Speech Recognition\', \'framework\': \'pyannote.audio\', \'functionality\': \'Speaker Diarization\', \'api_name\': \'pyannote/speaker-diarization\', \'api_call\': "Pipeline.from_pretrained(\'pyannote/speaker-diarization@2.1\', use_auth_token=\'ACCESS_TOKEN_GOES_HERE\')", \'api_arguments\': {\'num_speakers\': \'int (optional)\', \'min_speakers\': \'int (optional)\', \'max_speakers\': \'int (optional)\'}, \'python_environment_requirements\': \'pyannote.audio 2.1.1\', \'example_code\': [\'from pyannote.audio import Pipeline\', \'pipeline = Pipeline.from_pretrained(pyannote/speaker-diarization@2.1, use_auth_token=ACCESS_TOKEN_GOES_HERE)\', \'diarization = pipeline(audio.wav)\', \'with open(audio.rttm, w) as rttm:\', \'  diarization.write_rttm(rttm)\'], \'performance\': {\'dataset\': \'ami\', \'accuracy\': {\'DER%\': \'18.91\', \'FA%\': \'4.48\', \'Miss%\': \'9.51\', \'Conf%\': \'4.91\'}}, \'description\': \'This API provides an automatic speaker diarization pipeline using the pyannote.audio framework. It can process audio files and output speaker diarization results in RTTM format. The pipeline can also handle cases where the number of speakers is known in advance or when providing lower and/or upper bounds on the number of speakers.\'}', metadata={})]


 We have a database of customer voices and are trying to build a voice recognition product so we can recognize customer voices when they call. How should we process and classify?\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Conversational\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Transformers\', \'api_name\': \'hyunwoongko/blenderbot-9B\', \'api_call\': "pipeline(\'conversational\', model=\'hyunwoongko/blenderbot-9B\')", \'api_arguments\': \'text\', \'python_environment_requirements\': \'transformers\', \'example_code\': \'Input a message to start chatting with hyunwoongko/blenderbot-9B.\', \'performance\': {\'dataset\': \'blended_skill_talk\', \'accuracy\': \'Not provided\'}, \'description\': \'Building open-domain chatbots is a challenging area for machine learning research. While prior work has shown that scaling neural models in the number of parameters and the size of the data they are trained on gives improved results, we show that other ingredients are important for a high-performing chatbot. Good conversation requires a number of skills that an expert conversationalist blends in a seamless way: providing engaging talking points and listening to their partners, both asking and answering questions, and displaying knowledge, empathy and personality appropriately, depending on the situation. We show that large scale models can learn these skills when given appropriate training data and choice of generation strategy. We build variants of these recipes with 90M, 2.7B and 9.4B parameter neural models, and make our models and code publicly available. Human evaluations show our best models are superior to existing approaches in multi-turn dialogue in terms of engagingness and humanness measurements. We then discuss the limitations of this work by analyzing failure cases of our models.\'}', metadata={})]


 We are developing a voice-controlled drone. Please identify the spoken command in the audio clip provided.\n###Input: \"audio_clip.wav\"\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Conversational\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Transformers\', \'api_name\': \'hyunwoongko/blenderbot-9B\', \'api_call\': "pipeline(\'conversational\', model=\'hyunwoongko/blenderbot-9B\')", \'api_arguments\': \'text\', \'python_environment_requirements\': \'transformers\', \'example_code\': \'Input a message to start chatting with hyunwoongko/blenderbot-9B.\', \'performance\': {\'dataset\': \'blended_skill_talk\', \'accuracy\': \'Not provided\'}, \'description\': \'Building open-domain chatbots is a challenging area for machine learning research. While prior work has shown that scaling neural models in the number of parameters and the size of the data they are trained on gives improved results, we show that other ingredients are important for a high-performing chatbot. Good conversation requires a number of skills that an expert conversationalist blends in a seamless way: providing engaging talking points and listening to their partners, both asking and answering questions, and displaying knowledge, empathy and personality appropriately, depending on the situation. We show that large scale models can learn these skills when given appropriate training data and choice of generation strategy. We build variants of these recipes with 90M, 2.7B and 9.4B parameter neural models, and make our models and code publicly available. Human evaluations show our best models are superior to existing approaches in multi-turn dialogue in terms of engagingness and humanness measurements. We then discuss the limitations of this work by analyzing failure cases of our models.\'}', metadata={})]


 Make a summary video for our last team meeting. The audio from the video must identify who is speaking and when.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Multimodal Text-to-Video\', \'framework\': \'Hugging Face\', \'functionality\': \'Text-to-Video\', \'api_name\': \'camenduru/text2-video-zero\', \'api_call\': "pipeline(\'text-to-video\', model=\'camenduru/text2-video-zero\')", \'api_arguments\': [\'input_text\'], \'python_environment_requirements\': [\'transformers\'], \'example_code\': \'\', \'performance\': {\'dataset\': \'\', \'accuracy\': \'\'}, \'description\': \'This model is used for generating videos from text inputs. It is based on the Hugging Face framework and can be used with the transformers library. The model is trained on a variety of text and video datasets, and can be used for tasks such as video summarization, video generation from text prompts, and more.\'}', metadata={})]


 I want to estimate the price of a house based on its features using this API. Please provide the code.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Computer Vision Video Classification\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Video Classification\', \'api_name\': \'videomae-small-finetuned-ssv2\', \'api_call\': "VideoMAEForVideoClassification.from_pretrained(\'MCG-NJU/videomae-small-finetuned-ssv2\')", \'api_arguments\': {\'model_name\': \'MCG-NJU/videomae-small-finetuned-ssv2\'}, \'python_environment_requirements\': {\'transformers\': \'from transformers import VideoMAEFeatureExtractor, VideoMAEForVideoClassification\', \'numpy\': \'import numpy as np\', \'torch\': \'import torch\'}, \'example_code\': \'video = list(np.random.randn(16, 3, 224, 224))\\nfeature_extractor = VideoMAEFeatureExtractor.from_pretrained(MCG-NJU/videomae-small-finetuned-ssv2)\\nmodel = VideoMAEForVideoClassification.from_pretrained(MCG-NJU/videomae-small-finetuned-ssv2)\\ninputs = feature_extractor(video, return_tensors=pt)\\nwith torch.no_grad():\\n  outputs = model(**inputs)\\n  logits = outputs.logits\\npredicted_class_idx = logits.argmax(-1).item()\\nprint(Predicted class:, model.config.id2label[predicted_class_idx])\', \'performance\': {\'dataset\': \'Something-Something V2\', \'accuracy\': {\'top-1\': 66.8, \'top-5\': 90.3}}, \'description\': \'VideoMAE is an extension of Masked Autoencoders (MAE) to video. The architecture of the model is very similar to that of a standard Vision Transformer (ViT), with a decoder on top for predicting pixel values for masked patches. Videos are presented to the model as a sequence of fixed-size patches (resolution 16x16), which are linearly embedded. One also adds a [CLS] token to the beginning of a sequence to use it for classification tasks. One also adds fixed sinus/cosinus position embeddings before feeding the sequence to the layers of the Transformer encoder. By pre-training the model, it learns an inner representation of videos that can then be used to extract features useful for downstream tasks: if you have a dataset of labeled videos for instance, you can train a standard classifier by placing a linear layer on top of the pre-trained encoder. One typically places a linear layer on top of the [CLS] token, as the last hidden state of this token can be seen as a representation of an entire video.\'}', metadata={})]


 Our company wants to predict housing prices in the US based on given features. Help us use the trained model to predict the prices.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Tabular Tabular Regression\', \'framework\': \'Joblib\', \'functionality\': \'Single Column Regression\', \'api_name\': \'jwan2021/autotrain-us-housing-prices-1771761512\', \'api_call\': "joblib.load(\'model.joblib\')", \'api_arguments\': [\'data\'], \'python_environment_requirements\': [\'joblib\', \'pandas\', \'json\'], \'example_code\': "import json\\nimport joblib\\nimport pandas as pd\\nmodel = joblib.load(\'model.joblib\')\\nconfig = json.load(open(\'config.json\'))\\nfeatures = config[\'features\']\\ndata = pd.read_csv(\'data.csv\')\\ndata = data[features]\\ndata.columns = [\'feat_\' + str(col) for col in data.columns]\\npredictions = model.predict(data)", \'performance\': {\'dataset\': \'jwan2021/autotrain-data-us-housing-prices\', \'accuracy\': {\'Loss\': 122809.223, \'R2\': 0.884, \'MSE\': 15082105200.447, \'MAE\': 95586.887, \'RMSLE\': 0.13}}, \'description\': \'A model trained using AutoTrain for predicting US housing prices with single column regression. The model is based on the jwan2021/autotrain-data-us-housing-prices dataset and has a CO2 Emissions of 50.5369 grams.\'}', metadata={})]


 An environmental organization would like to use our Carbon Emissions prediction model to estimate CO2 emissions of different configurations of vehicles.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Question Answering\', \'framework\': \'Transformers\', \'functionality\': \'Question Answering\', \'api_name\': \'distilbert-base-uncased-distilled-squad\', \'api_call\': "pipeline(\'question-answering\', model=\'distilbert-base-uncased-distilled-squad\')", \'api_arguments\': [\'question\', \'context\'], \'python_environment_requirements\': [\'transformers\'], \'example_code\': "from transformers import pipeline\\nquestion_answerer = pipeline(question-answering, model=\'distilbert-base-uncased-distilled-squad\')\\ncontext = r\\n... Extractive Question Answering is the task of extracting an answer from a text given a question. An example of a\\n... question answering dataset is the SQuAD dataset, which is entirely based on that task. If you would like to fine-tune\\n... a model on a SQuAD task, you may leverage the examples/pytorch/question-answering/run_squad.py script.\\n... \\nresult = question_answerer(question=What is a good example of a question answering dataset?, context=context)\\nprint(\\n... fAnswer: \'{result[\'answer\']}\', score: {round(result[\'score\'], 4)}, start: {result[\'start\']}, end: {result[\'end\']}\\n...)", \'performance\': {\'dataset\': \'SQuAD v1.1\', \'accuracy\': \'86.9 F1 score\'}, \'description\': "DistilBERT base uncased distilled SQuAD is a fine-tuned version of DistilBERT-base-uncased for the task of question answering. It has 40% less parameters than bert-base-uncased, runs 60% faster while preserving over 95% of BERT\'s performances as measured on the GLUE language understanding benchmark."}', metadata={})]


 I am a data analyst working in pollution detection, find a model and develop a piece of code for me for environment monitoring.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Summarization\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Text-to-Text Generation\', \'api_name\': \'philschmid/bart-large-cnn-samsum\', \'api_call\': "pipeline(\'summarization\', model=\'philschmid/bart-large-cnn-samsum\')", \'api_arguments\': {\'model\': \'philschmid/bart-large-cnn-samsum\'}, \'python_environment_requirements\': {\'transformers\': \'latest\'}, \'example_code\': "from transformers import pipeline\\nsummarizer = pipeline(summarization, model=philschmid/bart-large-cnn-samsum)\\nconversation = \'\'\'Jeff: Can I train a 🤗 Transformers model on Amazon SageMaker? \\nPhilipp: Sure you can use the new Hugging Face Deep Learning Container. \\nJeff: ok.\\nJeff: and how can I get started? \\nJeff: where can I find documentation? \\nPhilipp: ok, ok you can find everything here. https://huggingface.co/blog/the-partnership-amazon-sagemaker-and-hugging-face <br />\\n\'\'\'\\nsummarizer(conversation)", \'performance\': {\'dataset\': \'samsum\', \'accuracy\': {\'eval_rouge1\': 42.621, \'eval_rouge2\': 21.9825, \'eval_rougeL\': 33.034, \'eval_rougeLsum\': 39.6783, \'test_rouge1\': 41.3174, \'test_rouge2\': 20.8716, \'test_rougeL\': 32.1337, \'test_rougeLsum\': 38.4149}}, \'description\': \'philschmid/bart-large-cnn-samsum is a BART-based model trained for text summarization on the SAMSum dataset. It can be used to generate abstractive summaries of conversations.\'}', metadata={})]


 We want to develop an intelligent prosthetic leg that can improve walking. Use a decision transformer to predict actions to be taken.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Conversational\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Transformers\', \'api_name\': \'hyunwoongko/blenderbot-9B\', \'api_call\': "pipeline(\'conversational\', model=\'hyunwoongko/blenderbot-9B\')", \'api_arguments\': \'text\', \'python_environment_requirements\': \'transformers\', \'example_code\': \'Input a message to start chatting with hyunwoongko/blenderbot-9B.\', \'performance\': {\'dataset\': \'blended_skill_talk\', \'accuracy\': \'Not provided\'}, \'description\': \'Building open-domain chatbots is a challenging area for machine learning research. While prior work has shown that scaling neural models in the number of parameters and the size of the data they are trained on gives improved results, we show that other ingredients are important for a high-performing chatbot. Good conversation requires a number of skills that an expert conversationalist blends in a seamless way: providing engaging talking points and listening to their partners, both asking and answering questions, and displaying knowledge, empathy and personality appropriately, depending on the situation. We show that large scale models can learn these skills when given appropriate training data and choice of generation strategy. We build variants of these recipes with 90M, 2.7B and 9.4B parameter neural models, and make our models and code publicly available. Human evaluations show our best models are superior to existing approaches in multi-turn dialogue in terms of engagingness and humanness measurements. We then discuss the limitations of this work by analyzing failure cases of our models.\'}', metadata={})]


 You want to create a bot that can play the Pong No Frameskip-v4 game with exceptional skill.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Text2Text Generation\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Transformers\', \'api_name\': \'valhalla/t5-base-e2e-qg\', \'api_call\': "pipeline(\'e2e-qg\', model=\'valhalla/t5-base-e2e-qg\')", \'api_arguments\': [\'text\'], \'python_environment_requirements\': [\'Hugging Face Transformers\'], \'example_code\': "from pipelines import pipeline\\n\\ntext = Python is an interpreted, high-level, general-purpose programming language. Created by Guido van Rossum and first released in 1991, Python\'s design philosophy emphasizes code readability with its notable use of significant whitespace.\\n\\nnlp = pipeline(e2e-qg, model=valhalla/t5-base-e2e-qg)\\n\\nnlp(text)", \'performance\': {\'dataset\': \'squad\', \'accuracy\': \'N/A\'}, \'description\': \'This is a T5-base model trained for end-to-end question generation task. Simply input the text and the model will generate multiple questions. You can play with the model using the inference API, just put the text and see the results!\'}', metadata={})]


 I am a game developer working on a game project involving moving carts. I need to use reinforcement learning to improve the game experience.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Question Answering\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Question Answering\', \'api_name\': \'csarron/bert-base-uncased-squad-v1\', \'api_call\': "pipeline(\'question-answering\', model=\'csarron/bert-base-uncased-squad-v1\', tokenizer=\'csarron/bert-base-uncased-squad-v1\')", \'api_arguments\': {\'model\': \'csarron/bert-base-uncased-squad-v1\', \'tokenizer\': \'csarron/bert-base-uncased-squad-v1\'}, \'python_environment_requirements\': \'Python 3.7.5\', \'example_code\': "from transformers import pipeline\\nqa_pipeline = pipeline(\\n question-answering,\\n model=csarron/bert-base-uncased-squad-v1,\\n tokenizer=csarron/bert-base-uncased-squad-v1\\n)\\npredictions = qa_pipeline({\\n \'context\': The game was played on February 7, 2016 at Levi\'s Stadium in the San Francisco Bay Area at Santa Clara, California.,\\n \'question\': What day was the game played on?\\n})\\nprint(predictions)", \'performance\': {\'dataset\': \'SQuAD1.1\', \'accuracy\': {\'EM\': 80.9, \'F1\': 88.2}}, \'description\': \'BERT-base uncased model fine-tuned on SQuAD v1. This model is case-insensitive and does not make a difference between english and English.\'}', metadata={})]


 Develop a soccer playing agent that can outperform its opponents in a 2v2 environment.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Computer Vision Image Classification\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Image Classification\', \'api_name\': \'facebook/convnext-large-224\', \'api_call\': "ConvNextForImageClassification.from_pretrained(\'facebook/convnext-large-224\')", \'api_arguments\': {\'pretrained_model_name_or_path\': \'facebook/convnext-large-224\'}, \'python_environment_requirements\': {\'transformers\': \'Hugging Face Transformers\', \'torch\': \'PyTorch\', \'datasets\': \'Hugging Face Datasets\'}, \'example_code\': {\'import\': [\'from transformers import ConvNextFeatureExtractor, ConvNextForImageClassification\', \'import torch\', \'from datasets import load_dataset\'], \'load_dataset\': "dataset = load_dataset(\'huggingface/cats-image\')", \'image\': "image = dataset[\'test\'][\'image\'][0]", \'feature_extractor\': "feature_extractor = ConvNextFeatureExtractor.from_pretrained(\'facebook/convnext-large-224\')", \'model\': "model = ConvNextForImageClassification.from_pretrained(\'facebook/convnext-large-224\')", \'inputs\': "inputs = feature_extractor(image, return_tensors=\'pt\')", \'logits\': \'with torch.no_grad():\\n  logits = model(**inputs).logits\', \'predicted_label\': \'predicted_label = logits.argmax(-1).item()\', \'print\': \'print(model.config.id2label[predicted_label])\'}, \'performance\': {\'dataset\': \'imagenet-1k\', \'accuracy\': \'Not specified\'}, \'description\': "ConvNeXT is a pure convolutional model (ConvNet), inspired by the design of Vision Transformers, that claims to outperform them. The authors started from a ResNet and \'modernized\' its design by taking the Swin Transformer as inspiration."}', metadata={})]


 We are tasked to analyze text for a Russian newspaper to help understand general sentiment and trends in the text.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Text Classification\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'financial-sentiment-analysis\', \'api_name\': \'ProsusAI/finbert\', \'api_call\': "AutoModelForSequenceClassification.from_pretrained(\'ProsusAI/finbert\')", \'api_arguments\': \'text\', \'python_environment_requirements\': \'transformers\', \'example_code\': "from transformers import pipeline; classifier = pipeline(\'sentiment-analysis\', model=\'ProsusAI/finbert\'); classifier(\'your_text_here\')", \'performance\': {\'dataset\': \'Financial PhraseBank\', \'accuracy\': \'Not provided\'}, \'description\': \'FinBERT is a pre-trained NLP model to analyze sentiment of financial text. It is built by further training the BERT language model in the finance domain, using a large financial corpus and thereby fine-tuning it for financial sentiment classification. Financial PhraseBank by Malo et al. (2014) is used for fine-tuning.\'}', metadata={})]


 We want to generate an image from a textual description for our PowerPoint presentation.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Conversational\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Transformers\', \'api_name\': \'hyunwoongko/blenderbot-9B\', \'api_call\': "pipeline(\'conversational\', model=\'hyunwoongko/blenderbot-9B\')", \'api_arguments\': \'text\', \'python_environment_requirements\': \'transformers\', \'example_code\': \'Input a message to start chatting with hyunwoongko/blenderbot-9B.\', \'performance\': {\'dataset\': \'blended_skill_talk\', \'accuracy\': \'Not provided\'}, \'description\': \'Building open-domain chatbots is a challenging area for machine learning research. While prior work has shown that scaling neural models in the number of parameters and the size of the data they are trained on gives improved results, we show that other ingredients are important for a high-performing chatbot. Good conversation requires a number of skills that an expert conversationalist blends in a seamless way: providing engaging talking points and listening to their partners, both asking and answering questions, and displaying knowledge, empathy and personality appropriately, depending on the situation. We show that large scale models can learn these skills when given appropriate training data and choice of generation strategy. We build variants of these recipes with 90M, 2.7B and 9.4B parameter neural models, and make our models and code publicly available. Human evaluations show our best models are superior to existing approaches in multi-turn dialogue in terms of engagingness and humanness measurements. We then discuss the limitations of this work by analyzing failure cases of our models.\'}', metadata={})]


 A new manga has been released and we would like to provide a manga reader app with translations. Get the text from the manga image.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Multimodal Visual Question Answering\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Transformers\', \'api_name\': \'git-large-textvqa\', \'api_call\': "AutoModelForSeq2SeqLM.from_pretrained(\'microsoft/git-large-textvqa\')", \'api_arguments\': \'image, question\', \'python_environment_requirements\': \'transformers\', \'example_code\': \'For code examples, we refer to the documentation.\', \'performance\': {\'dataset\': \'TextVQA\', \'accuracy\': \'See table 11 in the paper for more details.\'}, \'description\': "GIT (short for GenerativeImage2Text) model, large-sized version, fine-tuned on TextVQA. It was introduced in the paper GIT: A Generative Image-to-text Transformer for Vision and Language by Wang et al. and first released in this repository. The model is trained using \'teacher forcing\' on a lot of (image, text) pairs. The goal for the model is simply to predict the next text token, giving the image tokens and previous text tokens. This allows the model to be used for tasks like: image and video captioning, visual question answering (VQA) on images and videos, and even image classification (by simply conditioning the model on the image and asking it to generate a class for it in text)."}', metadata={})]


 We are building a social media site which creates automatic captions for users when they post a picture\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Conversational\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Transformers\', \'api_name\': \'hyunwoongko/blenderbot-9B\', \'api_call\': "pipeline(\'conversational\', model=\'hyunwoongko/blenderbot-9B\')", \'api_arguments\': \'text\', \'python_environment_requirements\': \'transformers\', \'example_code\': \'Input a message to start chatting with hyunwoongko/blenderbot-9B.\', \'performance\': {\'dataset\': \'blended_skill_talk\', \'accuracy\': \'Not provided\'}, \'description\': \'Building open-domain chatbots is a challenging area for machine learning research. While prior work has shown that scaling neural models in the number of parameters and the size of the data they are trained on gives improved results, we show that other ingredients are important for a high-performing chatbot. Good conversation requires a number of skills that an expert conversationalist blends in a seamless way: providing engaging talking points and listening to their partners, both asking and answering questions, and displaying knowledge, empathy and personality appropriately, depending on the situation. We show that large scale models can learn these skills when given appropriate training data and choice of generation strategy. We build variants of these recipes with 90M, 2.7B and 9.4B parameter neural models, and make our models and code publicly available. Human evaluations show our best models are superior to existing approaches in multi-turn dialogue in terms of engagingness and humanness measurements. We then discuss the limitations of this work by analyzing failure cases of our models.\'}', metadata={})]


 There is robot in our factory which reads the image from the production line and then generate a text output based on the image.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Computer Vision Image-to-Image\', \'framework\': \'Hugging Face\', \'functionality\': \'Image-to-Image\', \'api_name\': \'GreeneryScenery/SheepsControlV3\', \'api_call\': "pipeline(\'image-to-image\', model=\'GreeneryScenery/SheepsControlV3\')", \'api_arguments\': {\'image\': \'Path to image file\', \'text_guidance\': \'Optional text guidance for the model\'}, \'python_environment_requirements\': {\'transformers\': \'latest\', \'torch\': \'latest\'}, \'example_code\': [\'from transformers import pipeline\', "model = pipeline(\'image-to-image\', model=\'GreeneryScenery/SheepsControlV3\')", "result = model({\'image\': \'path/to/image.jpg\', \'text_guidance\': \'Optional text guidance\'})"], \'performance\': {\'dataset\': \'GreeneryScenery/SheepsControlV3\', \'accuracy\': \'Not provided\'}, \'description\': \'GreeneryScenery/SheepsControlV3 is a model for image-to-image tasks. It can be used to generate images based on the input image and optional text guidance. The model has some limitations, such as the conditioning image not affecting the output image much. Improvements can be made by training for more epochs, using better prompts, and preprocessing the data.\'}', metadata={})]


 I am a filmmaker, and I need to make a short video based on a scene description from a script.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Multimodal Text-to-Video\', \'framework\': \'Hugging Face\', \'functionality\': \'Text-to-Video Synthesis\', \'api_name\': \'modelscope-damo-text-to-video-synthesis\', \'api_call\': "pipeline(\'text-to-video-synthesis\', model_dir.as_posix())", \'api_arguments\': {\'text\': \'A short text description in English\'}, \'python_environment_requirements\': [\'modelscope==1.4.2\', \'open_clip_torch\', \'pytorch-lightning\'], \'example_code\': "from huggingface_hub import snapshot_download\\nfrom modelscope.pipelines import pipeline\\nfrom modelscope.outputs import OutputKeys\\nimport pathlib\\n\\nmodel_dir = pathlib.Path(\'weights\')\\nsnapshot_download(\'damo-vilab/modelscope-damo-text-to-video-synthesis\',\\n repo_type=\'model\', local_dir=model_dir)\\n\\npipe = pipeline(\'text-to-video-synthesis\', model_dir.as_posix())\\n\\ntest_text = {\\n \'text\': \'A panda eating bamboo on a rock.\',\\n}\\n\\noutput_video_path = pipe(test_text,)[OutputKeys.OUTPUT_VIDEO]\\nprint(\'output_video_path:\', output_video_path)", \'performance\': {\'dataset\': \'Webvid, ImageNet, LAION5B\', \'accuracy\': \'Not provided\'}, \'description\': \'This model is based on a multi-stage text-to-video generation diffusion model, which inputs a description text and returns a video that matches the text description. Only English input is supported.\'}', metadata={})]


 I'm an author and want to create a short video based on a brief passage from my book. Can you generate a video based on this text?\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Multimodal Text-to-Video\', \'framework\': \'Hugging Face\', \'functionality\': \'Text-to-Video\', \'api_name\': \'camenduru/text2-video-zero\', \'api_call\': "pipeline(\'text-to-video\', model=\'camenduru/text2-video-zero\')", \'api_arguments\': [\'input_text\'], \'python_environment_requirements\': [\'transformers\'], \'example_code\': \'\', \'performance\': {\'dataset\': \'\', \'accuracy\': \'\'}, \'description\': \'This model is used for generating videos from text inputs. It is based on the Hugging Face framework and can be used with the transformers library. The model is trained on a variety of text and video datasets, and can be used for tasks such as video summarization, video generation from text prompts, and more.\'}', metadata={})]


 I want to build an AI model that can analyze images and answer questions about the content of the image.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Multimodal Visual Question Answering\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Transformers\', \'api_name\': \'ivelin/donut-refexp-combined-v1\', \'api_call\': "pipeline(\'visual-question-answering\', model=\'ivelin/donut-refexp-combined-v1\')", \'api_arguments\': \'image, question\', \'python_environment_requirements\': \'transformers\', \'example_code\': "vqa(image=\'path/to/image.jpg\', question=\'What is the color of the object?\')", \'performance\': {\'dataset\': \'ivelin/donut-refexp-combined-v1\', \'accuracy\': \'N/A\'}, \'description\': \'A visual question answering model that takes an image and a question as input and provides an answer based on the visual content of the image and the context of the question.\'}', metadata={})]


 We are trying to develop an application that helps tourists get information about attractions by analyzing images they take and responding to questions.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Conversational\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Transformers\', \'api_name\': \'hyunwoongko/blenderbot-9B\', \'api_call\': "pipeline(\'conversational\', model=\'hyunwoongko/blenderbot-9B\')", \'api_arguments\': \'text\', \'python_environment_requirements\': \'transformers\', \'example_code\': \'Input a message to start chatting with hyunwoongko/blenderbot-9B.\', \'performance\': {\'dataset\': \'blended_skill_talk\', \'accuracy\': \'Not provided\'}, \'description\': \'Building open-domain chatbots is a challenging area for machine learning research. While prior work has shown that scaling neural models in the number of parameters and the size of the data they are trained on gives improved results, we show that other ingredients are important for a high-performing chatbot. Good conversation requires a number of skills that an expert conversationalist blends in a seamless way: providing engaging talking points and listening to their partners, both asking and answering questions, and displaying knowledge, empathy and personality appropriately, depending on the situation. We show that large scale models can learn these skills when given appropriate training data and choice of generation strategy. We build variants of these recipes with 90M, 2.7B and 9.4B parameter neural models, and make our models and code publicly available. Human evaluations show our best models are superior to existing approaches in multi-turn dialogue in terms of engagingness and humanness measurements. We then discuss the limitations of this work by analyzing failure cases of our models.\'}', metadata={})]


 We have the financial documents of a company and we want to extract information about the cash flow. Modify the model so it can answer the questions related to the cash flow.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Summarization\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'text2text-generation\', \'api_name\': \'tuner007/pegasus_summarizer\', \'api_call\': "PegasusForConditionalGeneration.from_pretrained(\'tuner007/pegasus_summarizer\')", \'api_arguments\': [\'input_text\'], \'python_environment_requirements\': [\'pip install sentencepiece\'], \'example_code\': "context = \\nIndia wicket-keeper batsman Rishabh Pant has said someone from the crowd threw a ball on pacer Mohammed Siraj while he was fielding in the ongoing third Test against England on Wednesday. Pant revealed the incident made India skipper Virat Kohli upset. I think, somebody threw a ball inside, at Siraj, so he [Kohli] was upset, said Pant in a virtual press conference after the close of the first day\'s play.You can say whatever you want to chant, but don\'t throw things at the fielders and all those things. It is not good for cricket, I guess, he added.In the third session of the opening day of the third Test, a section of spectators seemed to have asked Siraj the score of the match to tease the pacer. The India pacer however came with a brilliant reply as he gestured 1-0 (India leading the Test series) towards the crowd.Earlier this month, during the second Test match, there was some bad crowd behaviour on a show as some unruly fans threw champagne corks at India batsman KL Rahul.Kohli also intervened and he was seen gesturing towards the opening batsman to know more about the incident. An over later, the TV visuals showed that many champagne corks were thrown inside the playing field, and the Indian players were visibly left frustrated.Coming back to the game, after bundling out India for 78, openers Rory Burns and Haseeb Hameed ensured that England took the honours on the opening day of the ongoing third Test.At stumps, England\'s score reads 120/0 and the hosts have extended their lead to 42 runs. For the Three Lions, Burns (52) and Hameed (60) are currently unbeaten at the crease.Talking about the pitch on opening day, Pant said, They took the heavy roller, the wicket was much more settled down, and they batted nicely also, he said. But when we batted, the wicket was slightly soft, and they bowled in good areas, but we could have applied [ourselves] much better.Both England batsmen managed to see off the final session and the hosts concluded the opening day with all ten wickets intact, extending the lead to 42.(ANI)\\n\\nget_response(context)", \'performance\': {\'dataset\': \'cnn_dailymail\', \'accuracy\': {\'ROUGE-1\': 36.604, \'ROUGE-2\': 14.64, \'ROUGE-L\': 23.884, \'ROUGE-LSUM\': 32.902, \'loss\': 2.576, \'gen_len\': 76.398}}, \'description\': \'PEGASUS fine-tuned for summarization\'}', metadata={})]


 Please generate a correct building plan leveraging the data given.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Text Generation\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Feature Extraction\', \'api_name\': \'sberbank-ai/sbert_large_mt_nlu_ru\', \'api_call\': "AutoModel.from_pretrained(\'sberbank-ai/sbert_large_mt_nlu_ru\')", \'api_arguments\': [\'sentences\', \'padding\', \'truncation\', \'max_length\', \'return_tensors\'], \'python_environment_requirements\': [\'transformers\', \'torch\'], \'example_code\': "from transformers import AutoTokenizer, AutoModel\\nimport torch\\n\\n\\n# Mean Pooling - Take attention mask into account for correct averaging\\ndef mean_pooling(model_output, attention_mask):\\n    token_embeddings = model_output[0]  # First element of model_output contains all token embeddings\\n    input_mask_expanded = attention_mask.unsqueeze(-1).expand(token_embeddings.size()).float()\\n    sum_embeddings = torch.sum(token_embeddings * input_mask_expanded, 1)\\n    sum_mask = torch.clamp(input_mask_expanded.sum(1), min=1e-9)\\n    return sum_embeddings / sum_mask\\n\\n\\n# Sentences we want sentence embeddings for sentences = [\'?\']\\n\\n# Load AutoModel from huggingface model repository\\ntokenizer = AutoTokenizer.from_pretrained(sberbank-ai/sbert_large_mt_nlu_ru)\\nmodel = AutoModel.from_pretrained(sberbank-ai/sbert_large_mt_nlu_ru)\\n\\n# Tokenize sentences\\nencoded_input = tokenizer(sentences, padding=True, truncation=True, max_length=24, return_tensors=\'pt\')\\n\\n# Compute token embeddings\\nwith torch.no_grad():\\n    model_output = model(**encoded_input)\\n\\n# Perform pooling. In this case, mean pooling\\nsentence_embeddings = mean_pooling(model_output, encoded_input[\'attention_mask\'])", \'performance\': {\'dataset\': \'Russian SuperGLUE\', \'accuracy\': \'Not provided\'}, \'description\': \'BERT large model multitask (cased) for Sentence Embeddings in Russian language.\'}', metadata={})]


 Help our drone video analyzing app estimate the depth in drone footage.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Conversational\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Transformers\', \'api_name\': \'hyunwoongko/blenderbot-9B\', \'api_call\': "pipeline(\'conversational\', model=\'hyunwoongko/blenderbot-9B\')", \'api_arguments\': \'text\', \'python_environment_requirements\': \'transformers\', \'example_code\': \'Input a message to start chatting with hyunwoongko/blenderbot-9B.\', \'performance\': {\'dataset\': \'blended_skill_talk\', \'accuracy\': \'Not provided\'}, \'description\': \'Building open-domain chatbots is a challenging area for machine learning research. While prior work has shown that scaling neural models in the number of parameters and the size of the data they are trained on gives improved results, we show that other ingredients are important for a high-performing chatbot. Good conversation requires a number of skills that an expert conversationalist blends in a seamless way: providing engaging talking points and listening to their partners, both asking and answering questions, and displaying knowledge, empathy and personality appropriately, depending on the situation. We show that large scale models can learn these skills when given appropriate training data and choice of generation strategy. We build variants of these recipes with 90M, 2.7B and 9.4B parameter neural models, and make our models and code publicly available. Human evaluations show our best models are superior to existing approaches in multi-turn dialogue in terms of engagingness and humanness measurements. We then discuss the limitations of this work by analyzing failure cases of our models.\'}', metadata={})]


 As a salesperson, I need to analyze customer invoices to answer questions about the total amount, tax, and due date from an image file.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Multimodal Document Question Answer\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Transformers\', \'api_name\': \'layoutlm-invoices\', \'api_call\': "AutoModelForDocumentQuestionAnswering.from_pretrained(\'impira/layoutlm-invoices\')", \'api_arguments\': \'question, context\', \'python_environment_requirements\': \'transformers\', \'example_code\': "nlp(question=\'What is the total amount?\', context=\'your_invoice_text\')", \'performance\': {\'dataset\': \'proprietary dataset of invoices, SQuAD2.0, and DocVQA\', \'accuracy\': \'Not provided\'}, \'description\': \'A fine-tuned version of the multi-modal LayoutLM model for the task of question answering on invoices and other documents. It has been fine-tuned on a proprietary dataset of invoices as well as both SQuAD2.0 and DocVQA for general comprehension. Unlike other QA models, which can only extract consecutive tokens, this model can predict longer-range, non-consecutive sequences with an additional classifier head.\'}', metadata={})]


 We need to find out the depth information of a room for monitoring purposes.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Conversational\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Transformers\', \'api_name\': \'hyunwoongko/blenderbot-9B\', \'api_call\': "pipeline(\'conversational\', model=\'hyunwoongko/blenderbot-9B\')", \'api_arguments\': \'text\', \'python_environment_requirements\': \'transformers\', \'example_code\': \'Input a message to start chatting with hyunwoongko/blenderbot-9B.\', \'performance\': {\'dataset\': \'blended_skill_talk\', \'accuracy\': \'Not provided\'}, \'description\': \'Building open-domain chatbots is a challenging area for machine learning research. While prior work has shown that scaling neural models in the number of parameters and the size of the data they are trained on gives improved results, we show that other ingredients are important for a high-performing chatbot. Good conversation requires a number of skills that an expert conversationalist blends in a seamless way: providing engaging talking points and listening to their partners, both asking and answering questions, and displaying knowledge, empathy and personality appropriately, depending on the situation. We show that large scale models can learn these skills when given appropriate training data and choice of generation strategy. We build variants of these recipes with 90M, 2.7B and 9.4B parameter neural models, and make our models and code publicly available. Human evaluations show our best models are superior to existing approaches in multi-turn dialogue in terms of engagingness and humanness measurements. We then discuss the limitations of this work by analyzing failure cases of our models.\'}', metadata={})]


 We are creating an autonomous car and need to estimate the depth of objects in a given scene.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Conversational\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Transformers\', \'api_name\': \'hyunwoongko/blenderbot-9B\', \'api_call\': "pipeline(\'conversational\', model=\'hyunwoongko/blenderbot-9B\')", \'api_arguments\': \'text\', \'python_environment_requirements\': \'transformers\', \'example_code\': \'Input a message to start chatting with hyunwoongko/blenderbot-9B.\', \'performance\': {\'dataset\': \'blended_skill_talk\', \'accuracy\': \'Not provided\'}, \'description\': \'Building open-domain chatbots is a challenging area for machine learning research. While prior work has shown that scaling neural models in the number of parameters and the size of the data they are trained on gives improved results, we show that other ingredients are important for a high-performing chatbot. Good conversation requires a number of skills that an expert conversationalist blends in a seamless way: providing engaging talking points and listening to their partners, both asking and answering questions, and displaying knowledge, empathy and personality appropriately, depending on the situation. We show that large scale models can learn these skills when given appropriate training data and choice of generation strategy. We build variants of these recipes with 90M, 2.7B and 9.4B parameter neural models, and make our models and code publicly available. Human evaluations show our best models are superior to existing approaches in multi-turn dialogue in terms of engagingness and humanness measurements. We then discuss the limitations of this work by analyzing failure cases of our models.\'}', metadata={})]


 Help us create an AI solution to automatically label images taken by a security camera.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Audio Automatic Speech Recognition\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Transformers\', \'api_name\': \'facebook/wav2vec2-xlsr-53-espeak-cv-ft\', \'api_call\': "Wav2Vec2ForCTC.from_pretrained(\'facebook/wav2vec2-xlsr-53-espeak-cv-ft\')", \'api_arguments\': {\'model_name\': \'facebook/wav2vec2-xlsr-53-espeak-cv-ft\'}, \'python_environment_requirements\': {\'transformers\': \'4.13.0\', \'torch\': \'1.10.0\', \'datasets\': \'1.14.0\'}, \'example_code\': \'processor = Wav2Vec2Processor.from_pretrained(facebook/wav2vec2-xlsr-53-espeak-cv-ft)\\nmodel = Wav2Vec2ForCTC.from_pretrained(facebook/wav2vec2-xlsr-53-espeak-cv-ft)\\nds = load_dataset(patrickvonplaten/librispeech_asr_dummy, clean, split=validation)\\ninput_values = processor(ds[0][audio][array], return_tensors=pt).input_values\\nwith torch.no_grad():\\n    logits = model(input_values).logits\\npredicted_ids = torch.argmax(logits, dim=-1)\\ntranscription = processor.batch_decode(predicted_ids)\', \'performance\': {\'dataset\': \'common_voice\', \'accuracy\': \'Not specified\'}, \'description\': \'Wav2Vec2-Large-XLSR-53 finetuned on multi-lingual Common Voice for phonetic label recognition in multiple languages. The model outputs a string of phonetic labels, and a dictionary mapping phonetic labels to words has to be used to map the phonetic output labels to output words.\'}', metadata={})]


 Develop a software to classify an image from a URL into a thousand categories.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Multimodal Image-to-Text\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Transformers\', \'api_name\': \'naver-clova-ix/donut-base\', \'api_call\': "AutoModel.from_pretrained(\'naver-clova-ix/donut-base\')", \'api_arguments\': \'image\', \'python_environment_requirements\': \'transformers\', \'example_code\': \'result = donut(image_path)\', \'performance\': {\'dataset\': \'arxiv:2111.15664\', \'accuracy\': \'Not provided\'}, \'description\': \'Donut consists of a vision encoder (Swin Transformer) and a text decoder (BART). Given an image, the encoder first encodes the image into a tensor of embeddings (of shape batch_size, seq_len, hidden_size), after which the decoder autoregressively generates text, conditioned on the encoding of the encoder.\'}', metadata={})]


 Our delivery drones need to detect and avoid obstacles while flying. Develop a solution for them to detect objects in their path.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Computer Vision Object Detection\', \'framework\': \'Transformers\', \'functionality\': \'Object Detection\', \'api_name\': \'fcakyon/yolov5s-v7.0\', \'api_call\': "yolov5.load(\'fcakyon/yolov5s-v7.0\')", \'api_arguments\': {\'conf\': 0.25, \'iou\': 0.45, \'agnostic\': False, \'multi_label\': False, \'max_det\': 1000, \'img\': \'https://github.com/ultralytics/yolov5/raw/master/data/images/zidane.jpg\', \'size\': 640, \'augment\': True}, \'python_environment_requirements\': \'pip install -U yolov5\', \'example_code\': "import yolov5\\nmodel = yolov5.load(\'fcakyon/yolov5s-v7.0\')\\nmodel.conf = 0.25\\nmodel.iou = 0.45\\nmodel.agnostic = False\\nmodel.multi_label = False\\nmodel.max_det = 1000\\nimg = \'https://github.com/ultralytics/yolov5/raw/master/data/images/zidane.jpg\'\\nresults = model(img)\\nresults = model(img, size=640)\\nresults = model(img, augment=True)\\npredictions = results.pred[0]\\nboxes = predictions[:, :4]\\nscores = predictions[:, 4]\\ncategories = predictions[:, 5]\\nresults.show()\\nresults.save(save_dir=\'results/\')", \'performance\': {\'dataset\': \'detection-datasets/coco\', \'accuracy\': None}, \'description\': \'Yolov5s-v7.0 is an object detection model trained on the COCO dataset. It can detect objects in images and return their bounding boxes, scores, and categories.\'}', metadata={})]


Develop a code to recognize objects in images using deformable-detr model.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Conversational\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Transformers\', \'api_name\': \'ToddGoldfarb/Cadet-Tiny\', \'api_call\': "AutoModelForSeq2SeqLM.from_pretrained(\'ToddGoldfarb/Cadet-Tiny\', low_cpu_mem_usage=True)", \'api_arguments\': {\'pretrained_model\': \'t5-small\', \'model_max_length\': 512}, \'python_environment_requirements\': {\'torch\': \'\', \'transformers\': \'\', \'colorful\': \'\'}, \'example_code\': "import torch\\nfrom transformers import AutoTokenizer, AutoModelForSeq2SeqLM\\nimport colorful as cf\\ncf.use_true_colors()\\ncf.use_style(\'monokai\')\\nclass CadetTinyAgent:\\n def init(self):\\n  print(cf.bold | cf.purple(Waking up Cadet-Tiny...))\\n  self.device = torch.device(cuda if torch.cuda.is_available() else cpu)\\n  self.tokenizer = AutoTokenizer.from_pretrained(t5-small, model_max_length=512)\\n  self.model = AutoModelForSeq2SeqLM.from_pretrained(ToddGoldfarb/Cadet-Tiny, low_cpu_mem_usage=True).to(self.device)\\n  self.conversation_history = \\ndef observe(self, observation):\\n self.conversation_history = self.conversation_history + observation\\n # The number 400 below is just a truncation safety net. It leaves room for 112 input tokens.\\n if len(self.conversation_history) > 400:\\n self.conversation_history = self.conversation_history[112:]\\ndef set_input(self, situation_narrative=, role_instruction=):\\n input_text = dialogue: \\n if situation_narrative != :\\n input_text = input_text + situation_narrative\\n if role_instruction != :\\n input_text = input_text +  <SEP>  + role_instruction\\n input_text = input_text +  <TURN>  + self.conversation_history\\n # Uncomment the line below to see what is fed to the model.\\n # print(input_text)\\n return input_text\\ndef generate(self, situation_narrative, role_instruction, user_response):\\n user_response = user_response +  <TURN> \\n self.observe(user_response)\\n input_text = self.set_input(situation_narrative, role_instruction)\\n inputs = self.tokenizer([input_text], return_tensors=pt).to(self.device)\\n # I encourage you to change the hyperparameters of the model! Start by trying to modify the temperature.\\n outputs = self.model.generate(inputs[input_ids], max_new_tokens=512, temperature=1, top_p=.95,\\n do_sample=True)\\n cadet_response = self.tokenizer.decode(outputs[0], skip_special_tokens=True, clean_up_tokenization_spaces=False)\\n added_turn = cadet_response +  <TURN> \\n self.observe(added_turn)\\n return cadet_response\\ndef reset_history(self):\\n self.conversation_history = []\\ndef run(self):\\n def get_valid_input(prompt, default):\\n  while True:\\n   user_input = input(prompt)\\n   if user_input in [Y, N, y, n]:\\n    return user_input\\n   if user_input == :\\n    return default\\n  while True:\\n   continue_chat = \\n   # MODIFY THESE STRINGS TO YOUR LIKING :)\\n   situation_narrative = Imagine you are Cadet-Tiny talking to ???.\\n   role_instruction = You are Cadet-Tiny, and you are talking to ???.\\n   self.chat(situation_narrative, role_instruction)\\n   continue_chat = get_valid_input(cf.purple(Start a new conversation with new setup? [Y/N]:), Y)\\n   if continue_chat in [N, n]:\\n    break\\n   print(cf.blue(CT: See you!))\\ndef chat(self, situation_narrative, role_instruction):\\n print(cf.green(\\n  Cadet-Tiny is running! Input [RESET] to reset the conversation history and [END] to end the conversation.))\\n while True:\\n  user_input = input(You: )\\n  if user_input == [RESET]:\\n   self.reset_history()\\n   print(cf.green([Conversation history cleared. Chat with Cadet-Tiny!]))\\n   continue\\n  if user_input == [END]:\\n   break\\n  response = self.generate(situation_narrative, role_instruction, user_input)\\n  print(cf.blue(CT:  + response))\\ndef main():\\n print(cf.bold | cf.blue(LOADING MODEL))\\nCadetTiny = CadetTinyAgent()\\nCadetTiny.run()\\nif name == \'main\':\\n main()", \'performance\': {\'dataset\': \'allenai/soda\', \'accuracy\': \'\'}, \'description\': \'Cadet-Tiny is a very small conversational model trained off of the SODA dataset. Cadet-Tiny is intended for inference at the edge (on something as small as a 2GB RAM Raspberry Pi). Cadet-Tiny is trained off of the t5-small pretrained model from Google, and is, as a result, is about 2% of the size of the Cosmo-3B model.\'}', metadata={})]


 I need to extract tables from a set of scanned document images to simplify data analysis.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Multimodal Document Question Answer\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Transformers\', \'api_name\': \'LayoutLMX_pt_question_answer_ocrazure_correct_V15_30_03_2023\', \'api_call\': "AutoModelForDocumentQuestionAnswering.from_pretrained(\'L-oenai/LayoutLMX_pt_question_answer_ocrazure_correct_V15_30_03_2023\')", \'api_arguments\': {}, \'python_environment_requirements\': {\'transformers\': \'>=4.11.0\'}, \'example_code\': {}, \'performance\': {\'dataset\': {}, \'accuracy\': {}}, \'description\': \'A document question answering model based on LayoutLMv2, which can be used to extract answers from images with text and layout information.\'}', metadata={})]


 Our customers wish to automatically detect shoplifters in the store using a surveillance camera. Help them to implement object detection and identify potential thieves.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Computer Vision Object Detection\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Object Detection\', \'api_name\': \'keremberke/yolov8m-csgo-player-detection\', \'api_call\': "YOLO(\'keremberke/yolov8m-csgo-player-detection\')", \'api_arguments\': {\'image\': \'https://github.com/ultralytics/yolov5/raw/master/data/images/zidane.jpg\'}, \'python_environment_requirements\': \'ultralyticsplus==0.0.23 ultralytics==8.0.21\', \'example_code\': "from ultralyticsplus import YOLO, render_result\\nmodel = YOLO(\'keremberke/yolov8m-csgo-player-detection\')\\nmodel.overrides[\'conf\'] = 0.25\\nmodel.overrides[\'iou\'] = 0.45\\nmodel.overrides[\'agnostic_nms\'] = False\\nmodel.overrides[\'max_det\'] = 1000\\nimage = \'https://github.com/ultralytics/yolov5/raw/master/data/images/zidane.jpg\'\\nresults = model.predict(image)\\nprint(results[0].boxes)\\nrender = render_result(model=model, image=image, result=results[0])\\nrender.show()", \'performance\': {\'dataset\': \'csgo-object-detection\', \'accuracy\': 0.892}, \'description\': "An object detection model trained to detect Counter-Strike: Global Offensive (CS:GO) players. The model is based on the YOLOv8 architecture and can identify \'ct\', \'cthead\', \'t\', and \'thead\' labels."}', metadata={})]


 Create an object detector that can detect blood cells in an image, such as platelets, red blood cells, and white blood cells.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Computer Vision Object Detection\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Blood Cell Detection\', \'api_name\': \'keremberke/yolov8n-blood-cell-detection\', \'api_call\': "YOLO(\'keremberke/yolov8n-blood-cell-detection\')", \'api_arguments\': {\'conf\': 0.25, \'iou\': 0.45, \'agnostic_nms\': False, \'max_det\': 1000}, \'python_environment_requirements\': \'ultralyticsplus==0.0.23 ultralytics==8.0.21\', \'example_code\': "from ultralyticsplus import YOLO, render_result\\nmodel = YOLO(\'keremberke/yolov8n-blood-cell-detection\')\\nmodel.overrides[\'conf\'] = 0.25\\nmodel.overrides[\'iou\'] = 0.45\\nmodel.overrides[\'agnostic_nms\'] = False\\nmodel.overrides[\'max_det\'] = 1000\\nimage = \'https://github.com/ultralytics/yolov5/raw/master/data/images/zidane.jpg\'\\nresults = model.predict(image)\\nprint(results[0].boxes)\\nrender = render_result(model=model, image=image, result=results[0])\\nrender.show()", \'performance\': {\'dataset\': \'blood-cell-object-detection\', \'accuracy\': 0.893}, \'description\': \'This model detects blood cells in images, specifically Platelets, RBC, and WBC. It is based on the YOLOv8 architecture and trained on the blood-cell-object-detection dataset.\'}', metadata={})]


 I am a real-estate agent working on a project where I need to convert images of room plans to a better visual representation.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Text2Text Generation\', \'framework\': \'Transformers\', \'functionality\': \'Sentence Correction\', \'api_name\': \'flexudy/t5-base-multi-sentence-doctor\', \'api_call\': "AutoModelWithLMHead.from_pretrained(\'flexudy/t5-base-multi-sentence-doctor\')", \'api_arguments\': [\'input_text\'], \'python_environment_requirements\': [\'transformers\'], \'example_code\': \'from transformers import AutoTokenizer, AutoModelWithLMHead\\ntokenizer = AutoTokenizer.from_pretrained(flexudy/t5-base-multi-sentence-doctor)\\nmodel = AutoModelWithLMHead.from_pretrained(flexudy/t5-base-multi-sentence-doctor)\\ninput_text = repair_sentence: m a medical doct context: {That is my job I a}{or I save lives} </s>\\ninput_ids = tokenizer.encode(input_text, return_tensors=pt)\\noutputs = model.generate(input_ids, max_length=32, num_beams=1)\\nsentence = tokenizer.decode(outputs[0], skip_special_tokens=True, clean_up_tokenization_spaces=True)\\nassert sentence == I am a medical doctor.\', \'performance\': {\'dataset\': \'tatoeba\', \'accuracy\': \'Not specified\'}, \'description\': \'Sentence doctor is a T5 model that attempts to correct the errors or mistakes found in sentences. Model works on English, German and French text.\'}', metadata={})]


 We recently received low resolution images of newly released products and need to upscale them for better quality.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Conversational\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Transformers\', \'api_name\': \'hyunwoongko/blenderbot-9B\', \'api_call\': "pipeline(\'conversational\', model=\'hyunwoongko/blenderbot-9B\')", \'api_arguments\': \'text\', \'python_environment_requirements\': \'transformers\', \'example_code\': \'Input a message to start chatting with hyunwoongko/blenderbot-9B.\', \'performance\': {\'dataset\': \'blended_skill_talk\', \'accuracy\': \'Not provided\'}, \'description\': \'Building open-domain chatbots is a challenging area for machine learning research. While prior work has shown that scaling neural models in the number of parameters and the size of the data they are trained on gives improved results, we show that other ingredients are important for a high-performing chatbot. Good conversation requires a number of skills that an expert conversationalist blends in a seamless way: providing engaging talking points and listening to their partners, both asking and answering questions, and displaying knowledge, empathy and personality appropriately, depending on the situation. We show that large scale models can learn these skills when given appropriate training data and choice of generation strategy. We build variants of these recipes with 90M, 2.7B and 9.4B parameter neural models, and make our models and code publicly available. Human evaluations show our best models are superior to existing approaches in multi-turn dialogue in terms of engagingness and humanness measurements. We then discuss the limitations of this work by analyzing failure cases of our models.\'}', metadata={})]


 As a toy company, we are designing a new toy line. We'd like you to create an image of a toy robot using relevant text prompts as control input.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Computer Vision Video Classification\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Video Classification\', \'api_name\': \'videomae-small-finetuned-ssv2\', \'api_call\': "VideoMAEForVideoClassification.from_pretrained(\'MCG-NJU/videomae-small-finetuned-ssv2\')", \'api_arguments\': {\'model_name\': \'MCG-NJU/videomae-small-finetuned-ssv2\'}, \'python_environment_requirements\': {\'transformers\': \'from transformers import VideoMAEFeatureExtractor, VideoMAEForVideoClassification\', \'numpy\': \'import numpy as np\', \'torch\': \'import torch\'}, \'example_code\': \'video = list(np.random.randn(16, 3, 224, 224))\\nfeature_extractor = VideoMAEFeatureExtractor.from_pretrained(MCG-NJU/videomae-small-finetuned-ssv2)\\nmodel = VideoMAEForVideoClassification.from_pretrained(MCG-NJU/videomae-small-finetuned-ssv2)\\ninputs = feature_extractor(video, return_tensors=pt)\\nwith torch.no_grad():\\n  outputs = model(**inputs)\\n  logits = outputs.logits\\npredicted_class_idx = logits.argmax(-1).item()\\nprint(Predicted class:, model.config.id2label[predicted_class_idx])\', \'performance\': {\'dataset\': \'Something-Something V2\', \'accuracy\': {\'top-1\': 66.8, \'top-5\': 90.3}}, \'description\': \'VideoMAE is an extension of Masked Autoencoders (MAE) to video. The architecture of the model is very similar to that of a standard Vision Transformer (ViT), with a decoder on top for predicting pixel values for masked patches. Videos are presented to the model as a sequence of fixed-size patches (resolution 16x16), which are linearly embedded. One also adds a [CLS] token to the beginning of a sequence to use it for classification tasks. One also adds fixed sinus/cosinus position embeddings before feeding the sequence to the layers of the Transformer encoder. By pre-training the model, it learns an inner representation of videos that can then be used to extract features useful for downstream tasks: if you have a dataset of labeled videos for instance, you can train a standard classifier by placing a linear layer on top of the pre-trained encoder. One typically places a linear layer on top of the [CLS] token, as the last hidden state of this token can be seen as a representation of an entire video.\'}', metadata={})]


 I'm developing a game that needs more Minecraft skins for some characters. How can I generete them with this model?\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Computer Vision Unconditional Image Generation\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Diffusers\', \'api_name\': \'Minecraft-Skin-Diffusion\', \'api_call\': "DDPMPipeline.from_pretrained(\'WiNE-iNEFF/Minecraft-Skin-Diffusion\')", \'api_arguments\': {}, \'python_environment_requirements\': [\'diffusers\'], \'example_code\': "from diffusers import DDPMPipeline\\npipeline = DDPMPipeline.from_pretrained(\'WiNE-iNEFF/Minecraft-Skin-Diffusion\')\\nimage = pipeline().images[0].convert(\'RGBA\')\\nimage", \'performance\': {\'dataset\': \'\', \'accuracy\': \'\'}, \'description\': \'Unconditional Image Generation model for generating Minecraft skins using diffusion-based methods.\'}', metadata={})]


 Find me a generative model to create cat images in 256x256 resolution.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Multimodal Text-to-Image\', \'framework\': \'Hugging Face\', \'functionality\': \'Text-to-Image Generation\', \'api_name\': \'stabilityai/stable-diffusion-2-1-base\', \'api_call\': "StableDiffusionPipeline.from_pretrained(\'stabilityai/stable-diffusion-2-1-base\', scheduler=EulerDiscreteScheduler.from_pretrained(stabilityai/stable-diffusion-2-1-base, subfolder=scheduler), torch_dtype=torch.float16)", \'api_arguments\': {\'prompt\': \'a photo of an astronaut riding a horse on mars\'}, \'python_environment_requirements\': [\'diffusers\', \'transformers\', \'accelerate\', \'scipy\', \'safetensors\'], \'example_code\': {\'install_dependencies\': \'pip install diffusers transformers accelerate scipy safetensors\', \'code\': \'from diffusers import StableDiffusionPipeline, EulerDiscreteScheduler\\nimport torch\\nmodel_id = stabilityai/stable-diffusion-2-1-base\\nscheduler = EulerDiscreteScheduler.from_pretrained(model_id, subfolder=scheduler)\\npipe = StableDiffusionPipeline.from_pretrained(model_id, scheduler=scheduler, torch_dtype=torch.float16)\\npipe = pipe.to(cuda)\\nprompt = a photo of an astronaut riding a horse on mars\\nimage = pipe(prompt).images[0]\\nimage.save(astronaut_rides_horse.png)\'}, \'performance\': {\'dataset\': \'COCO2017 validation set\', \'accuracy\': \'Not optimized for FID scores\'}, \'description\': \'Stable Diffusion v2-1-base is a diffusion-based text-to-image generation model that can generate and modify images based on text prompts. It is a Latent Diffusion Model that uses a fixed, pretrained text encoder (OpenCLIP-ViT/H). It is intended for research purposes only and can be used in areas such as safe deployment of models, understanding limitations and biases of generative models, generation of artworks, and research on generative models.\'}', metadata={})]


 Our organization works with video surveillance. We need a system to analyze the videos and classify various events happening inside the video.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Multimodal Text-to-Video\', \'framework\': \'Hugging Face\', \'functionality\': \'Text-to-Video\', \'api_name\': \'camenduru/text2-video-zero\', \'api_call\': "pipeline(\'text-to-video\', model=\'camenduru/text2-video-zero\')", \'api_arguments\': [\'input_text\'], \'python_environment_requirements\': [\'transformers\'], \'example_code\': \'\', \'performance\': {\'dataset\': \'\', \'accuracy\': \'\'}, \'description\': \'This model is used for generating videos from text inputs. It is based on the Hugging Face framework and can be used with the transformers library. The model is trained on a variety of text and video datasets, and can be used for tasks such as video summarization, video generation from text prompts, and more.\'}', metadata={})]


 People in my company need an automatic solution to categorize videos based on their content. The system should be able to recognize the main theme of a video with high accuracy.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Multimodal Text-to-Video\', \'framework\': \'Hugging Face\', \'functionality\': \'Text-to-Video\', \'api_name\': \'camenduru/text2-video-zero\', \'api_call\': "pipeline(\'text-to-video\', model=\'camenduru/text2-video-zero\')", \'api_arguments\': [\'input_text\'], \'python_environment_requirements\': [\'transformers\'], \'example_code\': \'\', \'performance\': {\'dataset\': \'\', \'accuracy\': \'\'}, \'description\': \'This model is used for generating videos from text inputs. It is based on the Hugging Face framework and can be used with the transformers library. The model is trained on a variety of text and video datasets, and can be used for tasks such as video summarization, video generation from text prompts, and more.\'}', metadata={})]


 We want to build a product to classify images of pets into different categories.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Multimodal Feature Extraction\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Feature Extraction\', \'api_name\': \'DeepPavlov/rubert-base-cased\', \'api_call\': "AutoModel.from_pretrained(\'DeepPavlov/rubert-base-cased\')", \'api_arguments\': [], \'python_environment_requirements\': [\'transformers\'], \'example_code\': \'\', \'performance\': {\'dataset\': \'Russian part of Wikipedia and news data\', \'accuracy\': \'\'}, \'description\': \'RuBERT (Russian, cased, 12‑layer, 768‑hidden, 12‑heads, 180M parameters) was trained on the Russian part of Wikipedia and news data. We used this training data to build a vocabulary of Russian subtokens and took a multilingual version of BERT‑base as an initialization for RuBERT[1].\'}', metadata={})]


 We are developing an app to classify food images. We have a set of images and want to use a pre-trained model for classification.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Conversational\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Transformers\', \'api_name\': \'hyunwoongko/blenderbot-9B\', \'api_call\': "pipeline(\'conversational\', model=\'hyunwoongko/blenderbot-9B\')", \'api_arguments\': \'text\', \'python_environment_requirements\': \'transformers\', \'example_code\': \'Input a message to start chatting with hyunwoongko/blenderbot-9B.\', \'performance\': {\'dataset\': \'blended_skill_talk\', \'accuracy\': \'Not provided\'}, \'description\': \'Building open-domain chatbots is a challenging area for machine learning research. While prior work has shown that scaling neural models in the number of parameters and the size of the data they are trained on gives improved results, we show that other ingredients are important for a high-performing chatbot. Good conversation requires a number of skills that an expert conversationalist blends in a seamless way: providing engaging talking points and listening to their partners, both asking and answering questions, and displaying knowledge, empathy and personality appropriately, depending on the situation. We show that large scale models can learn these skills when given appropriate training data and choice of generation strategy. We build variants of these recipes with 90M, 2.7B and 9.4B parameter neural models, and make our models and code publicly available. Human evaluations show our best models are superior to existing approaches in multi-turn dialogue in terms of engagingness and humanness measurements. We then discuss the limitations of this work by analyzing failure cases of our models.\'}', metadata={})]


 The company wants to use geolocalization techniques to identify the location of a given image.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Token Classification\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Entity Extraction\', \'api_name\': \'903429548\', \'api_call\': "AutoModelForTokenClassification.from_pretrained(\'ismail-lucifer011/autotrain-company_all-903429548\', use_auth_token=True)", \'api_arguments\': {\'inputs\': \'I love AutoTrain\'}, \'python_environment_requirements\': {\'transformers\': \'AutoModelForTokenClassification, AutoTokenizer\'}, \'example_code\': \'from transformers import AutoModelForTokenClassification, AutoTokenizer\\nmodel = AutoModelForTokenClassification.from_pretrained(ismail-lucifer011/autotrain-company_all-903429548, use_auth_token=True)\\ntokenizer = AutoTokenizer.from_pretrained(ismail-lucifer011/autotrain-company_all-903429548, use_auth_token=True)\\ninputs = tokenizer(I love AutoTrain, return_tensors=pt)\\noutputs = model(**inputs)\', \'performance\': {\'dataset\': \'ismail-lucifer011/autotrain-data-company_all\', \'accuracy\': 0.9979930566588805}, \'description\': \'A token classification model trained using AutoTrain for entity extraction. The model is based on the distilbert architecture and trained on the ismail-lucifer011/autotrain-data-company_all dataset. It can be used to identify and extract company names from text.\'}', metadata={})]


 To improve customer service, the company is developing an AI-based chatbot that can help generate multiple paraphrases of a given customer query. We want to know if the generated paraphrases are adequate.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Conversational\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Transformers\', \'api_name\': \'hyunwoongko/blenderbot-9B\', \'api_call\': "pipeline(\'conversational\', model=\'hyunwoongko/blenderbot-9B\')", \'api_arguments\': \'text\', \'python_environment_requirements\': \'transformers\', \'example_code\': \'Input a message to start chatting with hyunwoongko/blenderbot-9B.\', \'performance\': {\'dataset\': \'blended_skill_talk\', \'accuracy\': \'Not provided\'}, \'description\': \'Building open-domain chatbots is a challenging area for machine learning research. While prior work has shown that scaling neural models in the number of parameters and the size of the data they are trained on gives improved results, we show that other ingredients are important for a high-performing chatbot. Good conversation requires a number of skills that an expert conversationalist blends in a seamless way: providing engaging talking points and listening to their partners, both asking and answering questions, and displaying knowledge, empathy and personality appropriately, depending on the situation. We show that large scale models can learn these skills when given appropriate training data and choice of generation strategy. We build variants of these recipes with 90M, 2.7B and 9.4B parameter neural models, and make our models and code publicly available. Human evaluations show our best models are superior to existing approaches in multi-turn dialogue in terms of engagingness and humanness measurements. We then discuss the limitations of this work by analyzing failure cases of our models.\'}', metadata={})]


 We need to analyze user reviews for our app to determine whether they are positive, negative, or neutral.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Conversational\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Transformers\', \'api_name\': \'hyunwoongko/blenderbot-9B\', \'api_call\': "pipeline(\'conversational\', model=\'hyunwoongko/blenderbot-9B\')", \'api_arguments\': \'text\', \'python_environment_requirements\': \'transformers\', \'example_code\': \'Input a message to start chatting with hyunwoongko/blenderbot-9B.\', \'performance\': {\'dataset\': \'blended_skill_talk\', \'accuracy\': \'Not provided\'}, \'description\': \'Building open-domain chatbots is a challenging area for machine learning research. While prior work has shown that scaling neural models in the number of parameters and the size of the data they are trained on gives improved results, we show that other ingredients are important for a high-performing chatbot. Good conversation requires a number of skills that an expert conversationalist blends in a seamless way: providing engaging talking points and listening to their partners, both asking and answering questions, and displaying knowledge, empathy and personality appropriately, depending on the situation. We show that large scale models can learn these skills when given appropriate training data and choice of generation strategy. We build variants of these recipes with 90M, 2.7B and 9.4B parameter neural models, and make our models and code publicly available. Human evaluations show our best models are superior to existing approaches in multi-turn dialogue in terms of engagingness and humanness measurements. We then discuss the limitations of this work by analyzing failure cases of our models.\'}', metadata={})]


 Give me a tool to detect named entities in multiple languages for my news portal analysis.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Audio Automatic Speech Recognition\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Transformers\', \'api_name\': \'facebook/wav2vec2-xlsr-53-espeak-cv-ft\', \'api_call\': "Wav2Vec2ForCTC.from_pretrained(\'facebook/wav2vec2-xlsr-53-espeak-cv-ft\')", \'api_arguments\': {\'model_name\': \'facebook/wav2vec2-xlsr-53-espeak-cv-ft\'}, \'python_environment_requirements\': {\'transformers\': \'4.13.0\', \'torch\': \'1.10.0\', \'datasets\': \'1.14.0\'}, \'example_code\': \'processor = Wav2Vec2Processor.from_pretrained(facebook/wav2vec2-xlsr-53-espeak-cv-ft)\\nmodel = Wav2Vec2ForCTC.from_pretrained(facebook/wav2vec2-xlsr-53-espeak-cv-ft)\\nds = load_dataset(patrickvonplaten/librispeech_asr_dummy, clean, split=validation)\\ninput_values = processor(ds[0][audio][array], return_tensors=pt).input_values\\nwith torch.no_grad():\\n    logits = model(input_values).logits\\npredicted_ids = torch.argmax(logits, dim=-1)\\ntranscription = processor.batch_decode(predicted_ids)\', \'performance\': {\'dataset\': \'common_voice\', \'accuracy\': \'Not specified\'}, \'description\': \'Wav2Vec2-Large-XLSR-53 finetuned on multi-lingual Common Voice for phonetic label recognition in multiple languages. The model outputs a string of phonetic labels, and a dictionary mapping phonetic labels to words has to be used to map the phonetic output labels to output words.\'}', metadata={})]


 We are building a fiction-sharing platform for multiple languages. Extract named entities from the given text.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Conversational\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Transformers\', \'api_name\': \'hyunwoongko/blenderbot-9B\', \'api_call\': "pipeline(\'conversational\', model=\'hyunwoongko/blenderbot-9B\')", \'api_arguments\': \'text\', \'python_environment_requirements\': \'transformers\', \'example_code\': \'Input a message to start chatting with hyunwoongko/blenderbot-9B.\', \'performance\': {\'dataset\': \'blended_skill_talk\', \'accuracy\': \'Not provided\'}, \'description\': \'Building open-domain chatbots is a challenging area for machine learning research. While prior work has shown that scaling neural models in the number of parameters and the size of the data they are trained on gives improved results, we show that other ingredients are important for a high-performing chatbot. Good conversation requires a number of skills that an expert conversationalist blends in a seamless way: providing engaging talking points and listening to their partners, both asking and answering questions, and displaying knowledge, empathy and personality appropriately, depending on the situation. We show that large scale models can learn these skills when given appropriate training data and choice of generation strategy. We build variants of these recipes with 90M, 2.7B and 9.4B parameter neural models, and make our models and code publicly available. Human evaluations show our best models are superior to existing approaches in multi-turn dialogue in terms of engagingness and humanness measurements. We then discuss the limitations of this work by analyzing failure cases of our models.\'}', metadata={})]


 Someone asked the question \"What is the capital of Sweden?\" in the context \"Stockholm is the beautiful capital of Sweden, which is known for its high living standards and great attractions.\"\n###Input: {\"question\": \"What is the capital of Sweden?\", \"context\": \"Stockholm is the beautiful capital of Sweden, which is known for its high living standards and great attractions.\"}\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Question Answering\', \'framework\': \'Hugging Face Transformers\', \'functionality\': \'Question Answering\', \'api_name\': \'deepset/roberta-large-squad2\', \'api_call\': "pipeline(\'question-answering\', model=\'deepset/roberta-large-squad2\')", \'api_arguments\': [\'question\', \'context\'], \'python_environment_requirements\': [\'transformers\'], \'example_code\': "from transformers import pipeline; nlp = pipeline(\'question-answering\', model=\'deepset/roberta-large-squad2\'); nlp({\'question\': \'What is the capital of Germany?\', \'context\': \'Berlin is the capital of Germany.\'})", \'performance\': {\'dataset\': \'squad_v2\', \'accuracy\': \'Not provided\'}, \'description\': \'A pre-trained RoBERTa model for question answering tasks, specifically trained on the SQuAD v2 dataset. It can be used to answer questions based on a given context.\'}', metadata={})]


 Write an overview for astronomers about how Jupiter became the largest planet in our solar system.\n
 Use this API documentation for reference: [Document(page_content='{\'domain\': \'Natural Language Processing Summarization\', \'framework\': \'Transformers\', \'functionality\': \'text2text-generation\', \'api_name\': \'financial-summarization-pegasus\', \'api_call\': "PegasusForConditionalGeneration.from_pretrained(\'human-centered-summarization/financial-summarization-pegasus\')", \'api_arguments\': [\'model_name\'], \'python_environment_requirements\': [\'transformers\'], \'example_code\': \'from transformers import PegasusTokenizer, PegasusForConditionalGeneration, TFPegasusForConditionalGeneration\\nmodel_name = human-centered-summarization/financial-summarization-pegasus\\ntokenizer = PegasusTokenizer.from_pretrained(model_name)\\nmodel = PegasusForConditionalGeneration.from_pretrained(model_name)\\ntext_to_summarize = National Commercial Bank (NCB), Saudi Arabia’s largest lender by assets, agreed to buy rival Samba Financial Group for $15 billion in the biggest banking takeover this year.NCB will pay 28.45 riyals ($7.58) for each Samba share, according to a statement on Sunday, valuing it at about 55.7 billion riyals. NCB will offer 0.739 new shares for each Samba share, at the lower end of the 0.736-0.787 ratio the banks set when they signed an initial framework agreement in June.The offer is a 3.5% premium to Samba’s Oct. 8 closing price of 27.50 riyals and about 24% higher than the level the shares traded at before the talks were made public. Bloomberg News first reported the merger discussions.The new bank will have total assets of more than $220 billion, creating the Gulf region’s third-largest lender. The entity’s $46 billion market capitalization nearly matches that of Qatar National Bank QPSC, which is still the Middle East’s biggest lender with about $268 billion of assets.\\ninput_ids = tokenizer(text_to_summarize, return_tensors=pt).input_ids\\noutput = model.generate(input_ids, max_length=32, num_beams=5, early_stopping=True)\\nprint(tokenizer.decode(output[0], skip_special_tokens=True))\', \'performance\': {\'dataset\': \'xsum\', \'accuracy\': {\'ROUGE-1\': 35.206, \'ROUGE-2\': 16.569, \'ROUGE-L\': 30.128, \'ROUGE-LSUM\': 30.171}}, \'description\': \'This model was fine-tuned on a novel financial news dataset, which consists of 2K articles from Bloomberg, on topics such as stock, markets, currencies, rate and cryptocurrencies. It is based on the PEGASUS model and in particular PEGASUS fine-tuned on the Extreme Summarization (XSum) dataset: google/pegasus-xsum model. PEGASUS was originally proposed by Jingqing Zhang, Yao Zhao, Mohammad Saleh and Peter J. Liu in PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization.\'}', metadata={})]