amazon web services - AWS feed processing - How to make sure that processing is done sequentially? -
we processing xml/json feeds.
need process files sequentially.
want store them database.
our workflow:
- download feed (xml/json file)
- process feed using step function
- finally, step function stores data in database
the downloaded feed 1 newest data, want process them sequentially, since need difference between each feed.
files processed slower/faster others, due difference in size.
now because file sizes different, problem processing step functions overlap eachother , wrong data goes database.
is using step functions right way go this, or there better alternative our workflow overlooking?
how make sure process feeds sequentially?
Comments
Post a Comment