Skip to content
This repository has been archived by the owner on Sep 23, 2024. It is now read-only.

Infinite loop requesting messages #41

Open
rumeau opened this issue Apr 19, 2022 · 0 comments
Open

Infinite loop requesting messages #41

rumeau opened this issue Apr 19, 2022 · 0 comments
Labels
bug Something isn't working

Comments

@rumeau
Copy link

rumeau commented Apr 19, 2022

Describe the bug
Hello. I'm using this tap to get SMS messages information to our postgres target. The problem is that a couple of weeks ago the taps failed to find a state file and start a full refresh of data unfortunately it got stuck on an infinite loop requesting pages.

I've checked our twilio panel and for March we've got about 170k messages, that should be extracted on over 3700 pages of 50 items. But currently the tap is still runing on Page 1700000 aprox and not stopping. If I run the API call request manually I see that the response is returning data and a next_page_uri. Based on the Pages and the 50 batch items amount it seems I should have more than 85 million records and that is impossible. I've already check with API call and Twilio Console and I have less than 170000 message records for March.

To Reproduce
Steps to reproduce the behavior:

  1. Run the tap with 30 days window

Sample API call ```"next_page_uri": "/2010-04-01/Accounts/ACXXXXXXXXXXXXXX/Messages.json?DateSent%3E=2022-03-01&DateSent%3C=2022-03-31&PageSize=50&Page=1770548&PageToken=PASMXXXXXXXXXXXXX

Expected behavior
API Response should loop through all available pages and stop once completed.

Your environment

@rumeau rumeau added the bug Something isn't working label Apr 19, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant