Twitter Analytics Stack

[ThaliaBarrera]

Social Media Monitoring with Airbyte

Extract recent tweets, hashtags, or user data from the Twitter API using Airbyte. Load the data into a warehouse and analyze trends, sentiments, or influencer activities.

You can use a tool like dbt for data transformation, and an orchestrator like Airflow or Dagster if needed.

How to get started:

• Check out the README and the Contribution instructions in this repo.
• Check one of the existing quickstarts and observe their structure.
• (Optional, but highly recommended) Implement one of the quickstarts by following the instructions in their README. I recommend starting with E-commerce analytics in BigQuery

[gitadityakumar]

Hi @ThaliaBarrera ! I would like to give this a shot

[ThaliaBarrera]

Hi @gitadityakumar! Sure, I have assigned it to you. Let me know if you have any questions.

[gitadityakumar]

hey @ThaliaBarrera I have locally configured Airbyte and am currently in the process of utilizing the Twitter Community connectors. Upon providing the required Bearer Token, I encountered issues with the authentication process, which did not proceed as expected. Subsequently, I attempted to diagnose and resolve this issue using Postman, testing various methods in an attempt to retrieve a valid response. Regrettably, these efforts did not yield the desired results.

I would greatly appreciate your guidance in rectifying this matter, as I am fully committed to making a further attempt to address this issue and ensure its resolution. In the event that you believe I may be impeding the progress of resolving this concern, I kindly request that you consider reassigning it to another individual.

[ThaliaBarrera]

Hi @gitadityakumar. I'll try to reproduce the problem and tell you what I find. If it's a problem with the connector I'll also report to our team. In any case, thanks for letting us know!

If in the meantime you'd like to work on another issue, feel free to select one and let me know :).

[gitadityakumar]

hi @ThaliaBarrera I've discovered that the issue is on my end, as I have a free Twitter developer account, which doesn't grant me the ability to gather tweets and other data . I have attached some images for your reference. Now, I have one more question: If I come across an issue that aligns with my skill set and interest, can I submit a pull request (PR) without waiting for it to be assigned, provided that it isn't already assigned to someone else?

Also, I wanted to mention that, as a student, I can afford a $100 basic account.

[ThaliaBarrera]

@gitadityakumar sorry about the late response! Could you DM @marcosmarxm on Slack asking for Twitter credentials for the hackathon and include your email? Those credentials may help you get enough data to test.