Plugin and web browsing feature for Plus users

[wangjiyang]

OpenAI introduced web browsing and plugin feature for plus users. Do you have any idea on wrapping it with python ChatBot？

[hrizal]

because i dont have plus account, i try to add like this

embedded_gpt.py

import sys
import requests
import subprocess
from bs4 import BeautifulSoup
from sumy.parsers.html import HtmlParser
from sumy.nlp.tokenizers import Tokenizer
from sumy.summarizers.lsa import LsaSummarizer

def extract_summary(url, num_sentences=20):
    try:
        parser = HtmlParser.from_url(url, Tokenizer("english"))
        summarizer = LsaSummarizer()
        summary = summarizer(parser.document, num_sentences)

        if summary:
            return " ".join([str(sentence) for sentence in summary])
    except Exception as e:
        #print(f"Failed to extract summary: {e}")
        return ""

def search_yahoo(query):
    feeding = ""
    url = "https://search.yahoo.com/search"
    params = {
        "p": query,
        "fr2": "sb-top",
        "fr": "yfp-t",
    }

    try:
        response = requests.get(url, params=params)
        response.raise_for_status()

        soup = BeautifulSoup(response.content, "html.parser")
        search_results = soup.find_all("div", class_="algo-sr")
        #print("Search results:")
        for result in search_results:
            title = result.find("h3").get_text()
            url = result.find("a")["href"]
            summary = extract_summary(url, num_sentences=10)
            if summary is not None:
                feeding = feeding + summary + "\n\n"
    
        return feeding    

    except requests.exceptions.RequestException as e:
        print(f"Failed to perform the search: {e}")

then to use it I use a script like below

import sys
import json
from revChatGPT.V1 import Chatbot
from embedded_gpt import search_yahoo

c = {"access_token":"eyJh ..."} #your access_token
chatbot = Chatbot(config=c)

prompt = input("Question: ")

embbed = search_yahoo(prompt)
prompt = "Embedded: "+embbed+"\n\nQuestion: "+prompt

for data in chatbot.ask(
    prompt
):
    response = data["message"]

print(json.dumps(response))

[wangjiyang]

That's a nice try and good start. However, plugin and web browsing extends GPT's capability a lot. That makes very suitable for developing more exciting features.

[acheong08]

Added