Join the 80,000 other DTN customers who enjoy the fastest, most reliable data available. There is no better value than DTN!

(Move your cursor to this area to pause scrolling)




"I noticed that ******* quotes locked up shortly after the interest rate announcement yesterday while yours stayed stable." - Comment from Ron in Utah
"I use IQ Feed, Great stuff as far as data analysis information, storage and retrieval is concerned." - Comment from Public Forum
"As a past ******* customer(and not a happy one), IQ Feed by DTN is a much better and cheaper product with great customer support. I have had no problems at all since switching over." - Comment from Public Forum
"I just wanted to let u know that your data feed/service is by far the best!!! Your unfiltered tick data is excellent for reading order flow and none of your competitors delivers this quality of data!" - Comment from Peter via Email
"I will tell others who want to go into trading that DTN ProphetX is an invaluable tool, I don't think anyone can trade without it..." - Comment from Luther
"I have to tell you though that using the IQFeed API is about the easiest and cleanest I have seen for some time." - Comment from Jim
"IQ feed works very well, does not have all of the normal interruptions I have grown used to on *******" - Comment from Mark
"For anyone considering using DTN.IQ for a data feed, my experience with the quality of data and the tech support has been very positive." - Comment from Public Forum
"You are much better than lawyers or the phone company because you answer the phone when I call! I just love your customer service." - Comment from Isreal
"Boy, probably spent a thousand hours trying to get ******* API to work right. And now two hours to have something running with IQFeed. Hmmm, guess I was pretty stupid to fight rather than switch all this time. And have gotten more customer service from you guys already than total from them… in five years." - Comment from Jim
Home  Search  Register  Login  Blogs Recent Posts

Information on DTN's Industries:
DTN Oil & Gas | DTN Trading | DTN Agriculture | DTN Weather
Follow DTN_IQFeed on Twitter
DTN.IQ/IQFeed on Twitter
DTN News and Analysis on Twitter
»Forums Index »IQFeed Developer »IQFeed Developer Support »Corrupted L1 data-in recent past on multiple products at 'random' times
Author Topic: Corrupted L1 data-in recent past on multiple products at 'random' times (6 messages, Page 1 of 1)

aQuant
-Interested User-
Posts: 30
Joined: Jul 20, 2012


Posted: Oct 11, 2018 08:53 PM          Msg. 1 of 6
I have been seeing invalid and stale market data in various insturments (CL, ES) in the last month or so (could be slightly longer). It occurs at seemingly random times and usually lasts about 10 minutes sometimes up to an hour.
Example from today: 10:08-10:20am, 3:05-3:15pm CST in ES. Here is a snapshot of L1 updates from one of the periods:

Q,@ESZ18,2738.25,3859981,2,2738.00,2733.75,64,1,183,16:08:31.779471,271740673,16:08:31.770457,16:05:00.164499,C,
Q,@ESZ18,2738.25,3859982,1,2738.00,2733.75,64,1,183,16:08:31.779471,271740673,16:08:31.770457,16:05:00.164499,C,
Q,@ESZ18,2738.25,3859983,1,2738.00,2733.75,64,1,183,16:08:31.779471,271740673,16:08:31.770457,16:05:00.164499,C,
Q,@ESZ18,2738.25,3859984,1,2738.00,2733.75,64,1,183,16:08:31.779471,271740673,16:08:31.770457,16:05:00.164499,C,
Q,@EDU20,96.7650,270309,2,96.7650,96.7700,8665,15942,,16:07:28.306149,9268532,16:08:31.734942,16:08:31.768035,a,
Q,@EDM19,96.9800,405656,2,96.9800,96.9850,7411,30599,,16:00:00.036589,9268244,16:08:31.753186,16:08:31.768255,a,
Q,@EDU20,96.7650,270309,2,96.7650,96.7700,8665,15824,,16:07:28.306149,9268532,16:08:31.734942,16:08:31.768255,a,
Q,@EDH20,96.7650,342864,2,96.7650,96.7700,4985,27436,,16:07:28.306149,9268541,16:08:31.734935,16:08:31.768255,a,
Q,@EDM20,96.7600,348765,3,96.7600,96.7650,6401,20909,,16:07:28.306149,9268536,16:08:31.733403,16:08:31.768255,a,
Q,@ESZ18,2738.25,3859984,1,2738.25,2733.75,13,1,,16:08:31.779471,271740673,16:08:31.779481,16:05:00.164499,b,
Q,@ESZ18,2738.25,3859984,1,2738.25,2733.75,14,1,,16:08:31.779471,271740673,16:08:31.779658,16:05:00.164499,b,
Q,@ESZ18,2738.25,3859984,1,2738.25,2733.75,15,1,,16:08:31.779471,271740673,16:08:31.779676,16:05:00.164499,b,

In the above (and with my message structure) the best bid/ask data are crossed and indicating 2738.25,2733.75 for bid and ask for ES, clearly nonsensical. This same stale/invalid bid/ask info stays such for the period in question. Notice that ED above (eurodollar) is just fine as are most other contracts. This has been happening for over a month and I alerted iqfeed support to it. Initially they expressed it was due to testing MBO feed. When I contended those reasons they claimed they had some issues with CME feed. Whatever it is, this is not getting fixed and I am concerned this is not getting the priority it deserves. Any advanced developer depends on full/complete/correct data-as the feed proclaims to provide. Please correct this issue. I can provide more details if needed.

DTN_Tim Walter
-DTN Guru-
Posts: 1238
Joined: Apr 25, 2006


Posted: Oct 12, 2018 06:52 AM          Msg. 2 of 6
Good morning,

I apologize that this continues to happen and for my poor communication of our concern over it. We are very concerned with the quality of our data. To that end, here we have added the CME trade aggressor flag to our level one data. This flag tells if the trade occurred at the bid or the ask, so not only will you save on the processing, but you will have a definite answer on every trade of where it occurred. We hope to have this available to our developers later this month as a beta, but 4th quarter for sure. We have also developed better ways to identify when these situations occur, so that we can ensure quality and strive towards a continuous improvement to our data.

I know that the people that are needed to insure the continued priority of this work actively watch the forums and I know that your concerns will only help to keep the focus where it needs to be. I will try to keep you more in the loop in the future when related updates occur.

Tim

developer_hm
-Interested User-
Posts: 2
Joined: Oct 26, 2018


Posted: Oct 26, 2018 03:05 PM          Msg. 3 of 6
I am also still seeing this issue. Sometimes restarting the instance of iqfeed resolves the issue, but often times it does not. I've been noticing that for many instruments that trade on the CME, a bid or ask will get stuck at a particular price for several hours.

Constantly having these bad prices is making the data effectively unusable. Do you have an ETA on when the CME data will become usable again?

aQuant
-Interested User-
Posts: 30
Joined: Jul 20, 2012


Posted: Oct 26, 2018 08:28 PM          Msg. 4 of 6
Today was particularly bad, CL and currency data (CL, 6E, 6A,6J) all had this issue for hours after 9:31am central time.

developer_hm
-Interested User-
Posts: 2
Joined: Oct 26, 2018


Posted: Oct 29, 2018 08:01 AM          Msg. 5 of 6
I agree that Friday was particularly bad. The entire strip November expiring ESZ8 options was giving me bad prices, which was throwing off calculations we use to drive our model.

DTN_Steve_S
-DTN Guru-
Posts: 2062
Joined: Nov 21, 2005


Posted: Oct 29, 2018 09:32 AM          Msg. 6 of 6
Hello, we are continuing to monitor and make changes to address this issue. Friday was particularly bad since we had several different issues contributing to make the problem worse. We made some configuration changes on our servers over the weekend and continue to actively work with our providers to get the issue resolved.
 

 

Time: Wed January 16, 2019 11:15 PM CFBB v1.2.0 15 ms.
© AderSoftware 2002-2003