Your data is loading for a txt file, so the update frequency in the current system will be limited by the frequency that the txt data is updated.
How often can you refresh the txt file?
Can you connect directly to the database and set the server to reload more frequently?
Direct Discovery may be an option if you can connect directly to the database.
There are some limitations on the direct discovery functionality and the options available depend on which version and SR you are using. The FAQ below gives more details.