Join the 80,000 other DTN customers who enjoy the fastest, most reliable data available. There is no better value than DTN!

(Move your cursor to this area to pause scrolling)




"DTN has never given me problems. It is incredibly stable. In fact I've occasionally lost the data feed from Interactive Brokers, but still been able to trade because I'm getting good data from DTN." - Comment from Leighton
"Everything is working great with the API. I love it." - Comment from Calvin
"IQ feed works very well, does not have all of the normal interruptions I have grown used to on *******" - Comment from Mark
"I use IQ Feed, Great stuff as far as data analysis information, storage and retrieval is concerned." - Comment from Public Forum
"I "bracket trade" all major news releases and I have not found one lag or glitch with DTN.IQ feed. I am very comfortable with their feed under all typical news conditions (Fed releases, employment numbers, etc)." - Comment from Public Forum
"I am enjoying the feed very much - so superior to the broker provided feed I was previously using." - Comment from George
"I just wanted to let u know that your data feed/service is by far the best!!! Your unfiltered tick data is excellent for reading order flow and none of your competitors delivers this quality of data!" - Comment from Peter via Email
"The service is great, I see a noticeable improvement in my volume profiles over [broker]'s data feed" - Comment from Larry
"Boy, probably spent a thousand hours trying to get ******* API to work right. And now two hours to have something running with IQFeed. Hmmm, guess I was pretty stupid to fight rather than switch all this time. And have gotten more customer service from you guys already than total from them… in five years." - Comment from Jim
"For anyone considering using DTN.IQ for a data feed, my experience with the quality of data and the tech support has been very positive." - Comment from Public Forum
Home  Search  Register  Login  Blogs Recent Posts

Information on Various DTN Products:
DTN IQFeed | DTN ProphetX | DTN Ag | NxCore
Follow DTN_IQFeed on Twitter
DTN.IQ/IQFeed on Twitter
DTN News and Analysis on Twitter
»Forums Index »IQFeed Developer »IQFeed Developer Support »ESZ16 is missing intraday back fill for 11/7
Author Topic: ESZ16 is missing intraday back fill for 11/7 (13 messages, Page 1 of 1)

mattgundersen
-Interested User-
Posts: 13
Joined: Jun 23, 2015


Posted: Nov 7, 2016 05:51 PM          Msg. 1 of 13
Hi,

If I make a request for @ESZ16 or @ES# today's historical data is missing. Is there something wrong with the EMini history? Everything was fine until today.

If I request SPX.XO, or Forex Pairs such as: @EU#, @JY#, @BP#, ... today's data is present.

The command I'm sending is:
Command: HID,@ESZ16,600,30,,000000,235959,1,@ESZ16-10

Data is returned (
@ESZ16-10,2016-10-09 18:10:00,2153.25,2150.75,2152.00,2152.50,8496,8493,0,
@ESZ16-10,2016-10-09 18:20:00,2153.25,2152.00,2152.50,2152.25,9609,1113,0,
@ESZ16-10,2016-10-09 18:30:00,2152.75,2151.75,2152.25,2152.25,10164,554,0,
@ESZ16-10,2016-10-09 18:40:00,2153.75,2152.00,2152.50,2153.00,11840,1676,0,
... many other rows.

these are the last rows received

@ESZ16-10,2016-11-06 23:40:00,2106.75,2106.00,2106.75,2106.50,112577,872,0,
@ESZ16-10,2016-11-06 23:50:00,2106.75,2106.00,2106.25,2106.50,112866,289,0,
@ESZ16-10,2016-11-07 00:00:00,2107.00,2106.00,2106.75,2106.00,113506,640,0,
@ESZ16-10,!ENDMSG!,

mattgundersen
-Interested User-
Posts: 13
Joined: Jun 23, 2015


Posted: Nov 7, 2016 05:56 PM          Msg. 2 of 13
Btw, If I restrict the BeginFilterTime and EndFilterTime todays bars (within the time restriction) appear.
Command: HID,@ESZ16,600,30,,080000,160000,1,@ESZ16-10

But I've been using 000000 - 235959 for months. Was there a change I missed that I need to apply?

mattgundersen
-Interested User-
Posts: 13
Joined: Jun 23, 2015


Posted: Nov 7, 2016 06:09 PM          Msg. 3 of 13
Did some debugging. With EndFilterTime = 235959.

As long as BeginFilterTime >= 013920 today's data shows up from that point forward.
If < 013920 today's data does not fill in.

quickTick
-Interested User-
Posts: 34
Joined: Nov 17, 2013


Posted: Nov 7, 2016 06:43 PM          Msg. 4 of 13
Maybe just the 600 data points limit you specified?

mattgundersen
-Interested User-
Posts: 13
Joined: Jun 23, 2015


Posted: Nov 7, 2016 06:51 PM          Msg. 5 of 13
I believe the 600 is the interval in seconds (10 minute chart = 10 * 60 = 600)

HID,[Symbol],[Interval],[Days],[MaxDatapoints],[BeginFilterTime],[EndFilterTime],[DataDirection],[RequestID],[DatapointsPerSend],[IntervalType]

[Symbol] - Required - Max Length 30 characters.
[Interval] - Required - The interval in seconds.
[Days] - Required - The number of calendar days ("1" equals current day) of history to be retrieved
[MaxDatapoints] - Optional - the maximum number of datapoints to be retrieved.
[BeginFilterTime] - Optional - Format HHmmSS - Allows you to specify the earliest time of day (Eastern) for which to receive data.
[EndFilterTime] - Optional - Format HHmmSS - Allows you to specify the latest time of day (Eastern) for which to receive data.
[DataDirection] - Optional - '0' (default) for "newest to oldest" or '1' for "oldest to newest".
[RequestID] - Optional - Will be sent back at the start of each line of data returned for this request.
[DatapointsPerSend] - Optional - Specifies the number of datapoints that IQConnect.exe will queue before attempting to send across the socket to your app.
[IntervalType] - Optional - 's' (default) for time intervals in seconds, 'v' for volume intervals, 't' for tick intervals

mattgundersen
-Interested User-
Posts: 13
Joined: Jun 23, 2015


Posted: Nov 7, 2016 06:53 PM          Msg. 6 of 13
I changed the data direction to 0 (which means newest to oldest).

This is what the first few data points are - only one 10 minute bar @ 00:00:00
@ESZ16-10,2016-11-07 00:00:00,2107.00,2106.00,2106.75,2106.00,113506,640,0,
@ESZ16-10,2016-11-06 23:50:00,2106.75,2106.00,2106.25,2106.50,112866,289,0,
@ESZ16-10,2016-11-06 23:40:00,2106.75,2106.00,2106.75,2106.50,112577,872,0,

DTN_Steve_S
-DTN Guru-
Posts: 2029
Joined: Nov 21, 2005


Posted: Nov 7, 2016 07:56 PM          Msg. 7 of 13
I can confirm this appears to be an issue in the servers. I haven't been able to identify exactly what is happening but I can duplicate the issue. I'll report this over to our server team for investigation.

For the current time, the workaround that seems to work consistently is to request the current day's data with a separate request.

DTN_Tim Walter
-DTN Guru-
Posts: 1093
Joined: Apr 25, 2006


Posted: Nov 8, 2016 07:11 AM          Msg. 8 of 13
This appears related to the DST rollover. We'll take a look at the bug and get it resolved before the next
one.

Tim

mattgundersen
-Interested User-
Posts: 13
Joined: Jun 23, 2015


Posted: Nov 8, 2016 08:29 AM          Msg. 9 of 13
Thanks for the quick responses Steve and Tim. I've got a workaround for now so I'm good :)

mattgundersen
-Interested User-
Posts: 13
Joined: Jun 23, 2015


Posted: Nov 10, 2016 01:21 PM          Msg. 10 of 13
Hi Steve and Tim,

My workaround is to request 020000 -> 235959. At some point I'd like to revert to original behavior of 000000 -> 235959 for my historical requests.

I just tried requesting 30 days of intraday data with begin/end time of 000000 -> 235959 and today's data is missing. Perhaps the behavior is today's data will always be missing with this DST bug? And only on emini? Any ETA on a fix?

Thanks, Matt

DTN_Tim Walter
-DTN Guru-
Posts: 1093
Joined: Apr 25, 2006


Posted: Nov 10, 2016 01:38 PM          Msg. 11 of 13
Hi Matt,

Since your filter is 000000 - 235959 anyhow, could you just remove the filter times? That should work fine in the interim if so.

I don't have any official ETA yet for you, but I know the fix has been passed over to QA to test, hopefully before the end of the year. But, I'll update you when I learn more.

Tim

mattgundersen
-Interested User-
Posts: 13
Joined: Jun 23, 2015


Posted: Nov 10, 2016 02:40 PM          Msg. 12 of 13
Hi Tim,

Thanks. I removed the filter times - works great.

m.

DTN_Tim Walter
-DTN Guru-
Posts: 1093
Joined: Apr 25, 2006


Posted: Nov 10, 2016 02:42 PM          Msg. 13 of 13
Good deal. I'll let you know when you can revert, should you choose to.

Tim
 

 

Time: Mon December 11, 2017 1:34 AM CFBB v1.2.0 15 ms.
© AderSoftware 2002-2003