obsei — AI Agent 工作流中文教程

initialize twitter source config

source_config = TwitterSourceConfig( keywords=["issue"], # Keywords, @user or #hashtags lookup_period="1h", # Lookup period from current time, format: <number><d|h|m> (day|hour|minute) cred_info=TwitterCredentials( # Enter your twitter consumer key and secret. Get it from https://developer.twitter.com/en/apply-for-access consumer_key="<twitter_consumer_key>", consumer_secret="<twitter_consumer_secret>", bearer_token='<ENTER BEARER TOKEN>', ) )

initialize Youtube source config

source_config = YoutubeScrapperConfig( video_url="https://www.youtube.com/watch?v=uZfns0JIlFk", # Youtube video URL fetch_replies=True, # Fetch replies to comments max_comments=10, # Total number of comments and replies to fetch lookup_period="1Y", # Lookup period from current time, format: <number><d|h|m|M|Y> (day|hour|minute|month|year) )

initialize facebook source config

source_config = FacebookSourceConfig( page_id="110844591144719", # Facebook page id, for example this one for Obsei lookup_period="1h", # Lookup period from current time, format: <number><d|h|m> (day|hour|minute) cred_info=FacebookCredentials( # Enter your facebook app_id, app_secret and long_term_token. Get it from https://developers.facebook.com/apps/ app_id="<facebook_app_id>", app_secret="<facebook_app_secret>", long_term_token="<facebook_long_term_token>", ) )

initialize email source config

source_config = EmailConfig( # List of IMAP servers for most commonly used email providers # https://www.systoolsgroup.com/imap/ # Also, if you're using a Gmail account then make sure you allow less secure apps on your account - # https://myaccount.google.com/lesssecureapps?pli=1 # Also enable IMAP access - # https://mail.google.com/mail/u/0/#settings/fwdandpop imap_server="imap.gmail.com", # Enter IMAP server cred_info=EmailCredInfo( # Enter your email account username and password username="<email_username>", password="<email_password>" ), lookup_period="1h" # Lookup period from current time, format: <number><d|h|m> (day|hour|minute) )

initialize Outscrapper Maps review source config

source_config = OSGoogleMapsReviewsConfig( # Collect API key from https://outscraper.com/ api_key="<Enter Your API Key>", # Enter Google Maps link or place id # For example below is for the "Taj Mahal" queries=["https://www.google.co.in/maps/place/Taj+Mahal/@27.1751496,78.0399535,17z/data=!4m5!3m4!1s0x39747121d702ff6d:0xdd2ae4803f767dde!8m2!3d27.1751448!4d78.0421422"], number_of_reviews=10, )

initialize app store source config

source_config = AppStoreScrapperConfig( # Need two parameters app_id and country. # app_id can be found at the end of the url of app in app store. # For example - https://apps.apple.com/us/app/xcode/id497799835 # 310633997 is the app_id for xcode and us is country. countries=["us"], app_id="310633997", lookup_period="1h" # Lookup period from current time, format: <number><d|h|m> (day|hour|minute) )

initialize play store source config

source_config = PlayStoreScrapperConfig( # Need two parameters package_name and country. # package_name can be found at the end of the url of app in play store. # For example - https://play.google.com/store/apps/details?id=com.google.android.gm&hl=en&gl=US # com.google.android.gm is the package_name for xcode and us is country. countries=["us"], package_name="com.google.android.gm", lookup_period="1h" # Lookup period from current time, format: <number><d|h|m> (day|hour|minute) )

initialize reddit source config

source_config = RedditConfig( subreddits=["wallstreetbets"], # List of subreddits # Reddit account username and password # You can also enter reddit client_id and client_secret or refresh_token # Create credential at https://www.reddit.com/prefs/apps # Also refer https://praw.readthedocs.io/en/latest/getting_started/authentication.html # Currently Password Flow, Read Only Mode and Saved Refresh Token Mode are supported cred_info=RedditCredInfo( username="<reddit_username>", password="<reddit_password>" ), lookup_period="1h" # Lookup period from current time, format: <number><d|h|m> (day|hour|minute) )

initialize reddit scrapper source config

source_config = RedditScrapperConfig( # Reddit subreddit, search etc rss url. For proper url refer following link - # Refer https://www.reddit.com/r/pathogendavid/comments/tv8m9/pathogendavids_guide_to_rss_and_reddit/ url="https://www.reddit.com/r/wallstreetbets/comments/.rss?sort=new", lookup_period="1h" # Lookup period from current time, format: <number><d|h|m> (day|hour|minute) )

initialize Google News source config

source_config = GoogleNewsConfig( query='bitcoin', max_results=5, # To fetch full article text enable fetch_article flag # By default google news gives title and highlight fetch_article=True, # proxy='http://127.0.0.1:8080' )

initialize website crawler source config

source_config = TrafilaturaCrawlerConfig( urls=['https://obsei.github.io/obsei/'] )

initialize pandas sink config

sink_config = PandasSourceConfig( dataframe=dataframe, include_columns=["score"], text_columns=["name", "degree"], )

initialize classification analyzer config

Vader does not need any configuration settings

analyzer_config=None

NER analyzer does not need configuration settings

analyzer_config=None

Translator does not need analyzer config

analyzer_config = None

initialize pii analyzer's config

analyzer_config = PresidioPIIAnalyzerConfig( # Whether to return only pii analysis or anonymize text analyze_only=False, # Whether to return detail information about anonymization decision return_decision_process=True )

initialize dummy analyzer's configuration settings

analyzer_config = DummyAnalyzerConfig()

initialize slack sink config

sink_config = SlackSinkConfig( # Provide slack bot/app token # For more detail refer https://slack.com/intl/en-de/help/articles/215770388-Create-and-regenerate-API-tokens slack_token="<Slack_app_token>", # To get channel id refer https://stackoverflow.com/questions/40940327/what-is-the-simplest-way-to-find-a-slack-team-id-and-a-channel-id channel_id="C01LRS6CT9Q" )

initialize zendesk sink config

sink_config = ZendeskSinkConfig( # provide zendesk domain domain="zendesk.com", # provide subdomain if you have one subdomain=None, # Enter zendesk user details cred_info=ZendeskCredInfo( email="<zendesk_user_email>", password="<zendesk_password>" ) )

initialize Jira sink config

sink_config = JiraSinkConfig( url="http://localhost:2990/jira", # Jira server url # Jira username & password for user who have permission to create issue username="<username>", password="<password>", # Which type of issue to be created # For more information refer https://support.atlassian.com/jira-cloud-administration/docs/what-are-issue-types/ issue_type={"name": "Task"}, # Under which project issue to be created # For more information refer https://support.atlassian.com/jira-software-cloud/docs/what-is-a-jira-software-project/ project={"key": "CUS"}, )

initialize Elasticsearch sink config

sink_config = ElasticSearchSinkConfig( # Elasticsearch server hosts="http://localhost:9200", # Index name, it will create if not exist index_name="test", )

For more details refer https://learning.postman.com/docs/designing-and-developing-your-api/mocking-data/setting-up-mock/

initialize http sink config (Currently only POST call is supported)

sink_config = HttpSinkConfig( # provide http server url url="https://localhost:8080/api/path", # Here you can add headers you would like to pass with request headers={ "Content-type": "application/json" } )

initialize pandas sink config

sink_config = PandasSinkConfig( dataframe=DataFrame() )

initialize logger sink config

sink_config = LoggerSinkConfig( logger=logger, level=logging.INFO )

logging.basicConfig(stream=sys.stdout, level=logging.INFO)

This will fetch information from configured source ie twitter, app store etc

source_response_list = source.lookup(source_config)

This will execute analyzer (Sentiment, classification etc) on source data with provided analyzer_config

analyzer_response_list = text_analyzer.analyze_input( source_response_list=source_response_list, analyzer_config=analyzer_config )

This will send analyzed output to configure sink ie Slack, Zendesk etc

sink_response_list = sink.send_data(analyzer_response_list, sink_config)

Refer https://developer.atlassian.com/server/framework/atlassian-sdk/atlas-run-standalone/

For supported models refer https://huggingface.co/models?filter=zero-shot-classification

text_analyzer = ZeroShotClassificationAnalyzer( model_name_or_path="typeform/mobilebert-uncased-mnli", device="auto" )

</details>
</td>
</tr>
<tr>
<td><details ><summary><img style="vertical-align:middle;margin:2px 10px" src="https://raw.githubusercontent.com/obsei/obsei-resources/master/logos/sentiment.png" width="20" height="20"><b>Sentiment Analyzer</b></summary><hr>

Sentiment Analyzer: Detect the sentiment of the text. Text classification can also perform sentiment analysis but if you don't want to use heavy-duty NLP model then use less resource hungry dictionary based Vader Sentiment detector.

For supported models refer https://huggingface.co/models?filter=token-classification

text_analyzer = NERAnalyzer( model_name_or_path="elastic/distilbert-base-cased-finetuned-conll03-english", device = "auto" )

</details>
</td>
</tr>
<tr>
<td><details ><summary><img style="vertical-align:middle;margin:2px 10px" src="https://raw.githubusercontent.com/obsei/obsei-resources/master/logos/translator.png" width="20" height="20"><b>Translator</b></summary><hr>

For supported models refer https://huggingface.co/models?pipeline_tag=translation

analyzer = TranslationAnalyzer( model_name_or_path="Helsinki-NLP/opus-mt-hi-en", device = "auto" )

</details>
</td>
</tr>
<tr>
<td><details ><summary><img style="vertical-align:middle;margin:2px 10px" src="https://raw.githubusercontent.com/obsei/obsei-resources/master/logos/pii.png" width="20" height="20"><b>PII Anonymizer</b></summary><hr>