Skip to content

Commit

Permalink
Merge branch 'main' into feature/etl-embededurl
Browse files Browse the repository at this point in the history
  • Loading branch information
@yu23ki14
yu23ki14 committed Oct 1, 2024
2 parents b493e3f + 9d75732 commit df7ecb9
Show file tree
Hide file tree
Showing 3 changed files with 25 additions and 1 deletion.
4 changes: 3 additions & 1 deletion etl/data/.gitignore
View file
Original file line number Diff line number Diff line change
@@ -1,2 +1,4 @@
*
transformed
note.db
notes.tsv
!.gitignore
11 changes: 11 additions & 0 deletions etl/data/noteStatus_sample.tsv
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
noteId noteAuthorParticipantId createdAtMillis timestampMillisOfFirstNonNMRStatus firstNonNMRStatus timestampMillisOfCurrentStatus currentStatus timestampMillisOfLatestNonNMRStatus mostRecentNonNMRStatus timestampMillisOfStatusLock lockedStatus timestampMillisOfRetroLock currentCoreStatus currentExpansionStatus currentGroupStatus currentDecidedBy currentModelingGroup timestampMillisOfMostRecentStatusChange timestampMillisOfNmrDueToMinStableCrhTime currentMultiGroupStatus currentModelingMultiGroup timestampMinuteOfFinalScoringOutput timestampMillisOfFirstNmrDueToMinStableCrhTime
1798638098865139789 F9DDA770486ED9ABE232B4FB9317B2DE61E511230D6504D18EA4EC0F9F8AECEF 1717663714506 1724694702420 NEEDS_MORE_RATINGS 1718876478700 NEEDS_MORE_RATINGS CoreModel (v1.1) -1 28791470
1798638211058864185 45E3B49059CB2C6BFDDB4BB147C284E8125BC4C45A1CD7BD458CDB95243B906D 1717663741254 1721920068424 NEEDS_MORE_RATINGS 1718876478700 NEEDS_MORE_RATINGS NEEDS_MORE_RATINGS NEEDS_MORE_RATINGS CoreModel (v1.1) -1 28791470
1798638402734059793 5C1B0A2FDB72D2D143C1EC29DA35B7A8DF1EC3EFD0FF05C5653B8A2194E9855E 1717663786954 1723042600983 NEEDS_MORE_RATINGS 1718876478700 NEEDS_MORE_RATINGS CoreModel (v1.1) -1 28791470
1798638535131779300 2E92945923B9733BCFF3CBA06564E371242895BA09A31035FFE48EB65693541A 1717663818519 1721920068424 NEEDS_MORE_RATINGS 1718876478700 NEEDS_MORE_RATINGS NEEDS_MORE_RATINGS NEEDS_MORE_RATINGS NEEDS_MORE_RATINGS CoreModel (v1.1) 14 -1 28791470
1798638568019222532 CA77AA4B5FE6E18697E2C74CAA6255A1D10311EC2AB9F81305231FCA40FC7BD2 1717663826363 1717692722854 CURRENTLY_RATED_NOT_HELPFUL 1723007622102 NEEDS_MORE_RATINGS 1717692722854 CURRENTLY_RATED_NOT_HELPFUL 1718876478700 NEEDS_MORE_RATINGS CURRENTLY_RATED_NOT_HELPFUL CoreModel (v1.1) -1 28791470
1798638646008188972 4D44CC205B086AEE4AF9BE3722AD7B79B288EE2BBA889B282B326DBF69D689C9 1717663844955 1721920068424 NEEDS_MORE_RATINGS 1718876478700 NEEDS_MORE_RATINGS NEEDS_MORE_RATINGS NEEDS_MORE_RATINGS CoreModel (v1.1) -1 28791470
1798638761229611200 57175C9A497861174F86BB3D6416D6CD5F9E7F43B67D6624B58F2AE3CDF0D6E3 1717663872427 1721920068424 NEEDS_MORE_RATINGS 1718876478700 NEEDS_MORE_RATINGS NEEDS_MORE_RATINGS NEEDS_MORE_RATINGS NEEDS_MORE_RATINGS CoreModel (v1.1) 3 -1 28791470
1798638898555519406 C766729C66167FAAC1B740A5AE1C904D7AB41BC9BE3C8A182E3824F03C640AF7 1717663905167 1725037572328 NEEDS_MORE_RATINGS 1718876478700 NEEDS_MORE_RATINGS CoreModel (v1.1) -1 28791470
1798639007921807589 3D156DF4D1E4BB732F6C6914EA8C06516B89FAF2750E249EAD292D33C808BE0D 1717663931242 1717754451401 CURRENTLY_RATED_HELPFUL 1721920068424 NEEDS_MORE_RATINGS 1717754451401 CURRENTLY_RATED_HELPFUL ExpansionPlusModel (v1.1) -1 28791470
1798639203670184367 4A1611D352FA747E30B0D7D0CA14455985CFD966C4FA52B9786C1E6F2338CB6E 1717663977912 1721920068424 NEEDS_MORE_RATINGS ExpansionPlusModel (v1.1) -1 28791470
11 changes: 11 additions & 0 deletions etl/data/notes_sample.tsv
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
noteId noteAuthorParticipantId createdAtMillis tweetId believable misleadingOther misleadingFactualError misleadingManipulatedMedia misleadingOutdatedInformation misleadingMissingImportantContext misleadingUnverifiedClaimAsFact misleadingSatire notMisleadingOther notMisleadingFactuallyCorrect notMisleadingOutdatedButNotWhenWritten notMisleadingClearlySatire notMisleadingPersonalOpinion trustworthySources isMediaNote classification harmful validationDifficulty summary
1807801430918799752 18F36FB51568FF6EC7F534AC8389090230FF8227AD78C392D47238E354C026D5 1719848423118 1807642401500213530 0 1 0 0 0 1 1 0 0 0 0 0 1 0 misinformed_or_potentially_misleading empty This is not verified and there is no source that will verify this claim. https://www.olympic.ph/
1807462030124949787 729E918C6B7F9135357914858D888CBCAE727F9DAAF263450817AB2AABD4F8D9 1719767503660 1807321009160106104 0 1 0 0 1 1 0 0 0 0 0 0 1 0 misinformed_or_potentially_misleading empty Anyone can apply to join the QT audience. BBC policy is to then select "a diverse range of British opinion" to broadly reflect the electoral map for "due impartiality, political fairness, and our intent to represent that wide range of views" https://www.bbc.co.uk/programmes/articles/5HrMm77Yz7vwzCZZ570nTdp/frequently-asked-questions https://centralbylines.co.uk/politics/bbc-question-time-perspectives-on-panel-audience-and-question-selection-bias/ Saville ref is a red herring
1807822563457773956 FD035E50D6E0AB6C4654F6363B3A5CC1587043CEBD4185A91668C51CED8E199D 1719853461506 1807792511894663438 0 1 0 0 0 0 0 0 0 0 0 0 1 0 misinformed_or_potentially_misleading empty Biden has no Constitutional powers to remove SCOTUS justices or any Judicial Branch official. They can only be removed by impeachment by the House, and conviction by the Senate (2/3rds vote needed). https://www.whitehouse.gov/about-the-white-house/our-government/the-judicial-branch/
1807818125049565695 2B0FE9787247C68AD1041F06B0F1B6056ECA6DB2638E6D746D8205F8FA1AD5C5 1719852403307 1807783706368614780 0 0 0 0 0 0 0 0 1 0 0 0 0 0 not_misleading empty NNN. If you want to debate the merits of the Supreme Court’s decision, then do so by replying. There is nothing to clarify in the original post, nor is the poster incorrect. Notes are the only thing that even marginally works on this site. Stop trying to break it.
1807754495637463160 631F0FB8F7E19BBED8F27D5E7A79788C63894C0DA7F325D698640046B7AE2456 1719837232870 1807739557464477921 0 1 1 0 0 0 0 0 0 0 0 0 1 0 misinformed_or_potentially_misleading empty A foto é enganosa. As notas de R$2 e R$20 só foram lançadas em 2001, 7 anos após o início do Plano Real. https://www.bcb.gov.br/detalhenoticia/359/noticia
1807831310938804558 A8A6E4AD258AC79F0DB3C0EFB943AD6002323667675E2E6785AA2054F58C84BD 1719855547064 1807801749794619549 0 1 0 0 1 0 0 0 0 0 0 0 1 0 misinformed_or_potentially_misleading empty In the full quote, Starmer says: "...to carve out really protected time for the kids, so on a Friday – I’ve been doing this for years – I will not do a work-related thing after six o’clock, pretty well come what may." https://uk.news.yahoo.com/starmer-children-away-pressure-job-080937883.html
1807841687315927240 3D97DB68002C4DA65F102C86AAA53DEB116B21631F4F127D4FD39F8D4763D3FE 1719858020988 1807611449335787668 0 0 0 0 1 0 0 0 0 0 0 0 1 1 misinformed_or_potentially_misleading empty This product is being marketed by a dropshipping outlet, typically sourcing its inventory from platforms like AliExpress. Be aware that there’s a risk that products may be counterfeit, unfit for use, and lack legal safety compliance. Some articles regarding dropshipping: https://www.bbc.co.uk/news/technology-53759932 https://www.vice.com/en/article/7kxepa/twitter-users-are-warning-each-other-about-its-junk-ads-with-community-notes https://www.vice.com/en/article/4a3ak9/twitters-verified-scam-store-accounts-thrive-as-humans-flee-the-site
1807479287668506959 DEB62FBCD1404066AF85A556DB410C6606F891F447FE41B0399436F27AD870A8 1719771618177 1807199349429981622 0 0 0 0 1 0 0 0 0 0 0 0 1 0 misinformed_or_potentially_misleading empty The receipt indicates contactless payment, which means the tip amount would have been entered by the customer on a tablet or handheld at the time of payment. Nothing you write on the receipt matters as it is your copy to keep. https://www.visa.co.uk/dam/VCOM/regional/na/us/run-your-business/documents/chip-payment-accept-restaurants-feb2019.pdf
1807831532327129139 DEB62FBCD1404066AF85A556DB410C6606F891F447FE41B0399436F27AD870A8 1719855599848 1807784784807993775 0 0 0 0 0 0 0 0 1 0 0 0 1 0 not_misleading empty NNN - as long as he calls it an official act, a court would need to rule otherwise. That is why the Supreme Court ruling is dangerous. Http://x.com
1807813697672548705 D912136BA8857180AA7822A3EE9DEA193E06E54F86372B9EE3663AC414F0875C 1719851347737 1807778877516783827 0 0 1 0 1 0 0 0 0 0 0 0 1 0 misinformed_or_potentially_misleading empty The video is edited to mislead. Please see here. https://pbs.twimg.com/amplify_video_thumb/1807799343828860928/img/PLPdptmidZhqb8vF?format=jpg&name=small

0 comments on commit df7ecb9

Please sign in to comment.