Join the 80,000 other DTN customers who enjoy the fastest, most reliable data available. There is no better value than DTN!

(Move your cursor to this area to pause scrolling)




"Previously I was using *******. IQFeed is WAY more economical, and for my charting needs is just as good, if not better." - Comment from Public Forum Post
"Thank God for your Data Feed as the only Zippers I see are on my pants (LOL), and no more 200 pip spikes to mess up charts." - Comment from Spiro via Email
"I'm very glad I switched to IQFeed. It's working perfectly with no lag, even during fast market conditions." - Comment from Andy via Email
"And by the way, have to say this. I love the IQFeed software. It's rock solid and it has a really nice API." - Comment from Thomas via RT Chat
"Thank you so much - awesome feed, awesome service!" - Comment from Greg via Email
"If someone needs the best quality data and backfill beyond what their broker provides at a rate that is the best in the industry, I highly recommend IQFeed." - Comment from Josh via Public Forum
"It’s so nice to be working with real professionals!" - Comment from Len
"I just wanted to let you know how fast and easy I found it to integrate IQFeed into our existing Java code using your JNI client. In my experience, such things almost never go so smoothly - great job!" - Comment from Nate
"Boy, probably spent a thousand hours trying to get ******* API to work right. And now two hours to have something running with IQFeed. Hmmm, guess I was pretty stupid to fight rather than switch all this time. And have gotten more customer service from you guys already than total from them… in five years." - Comment from Jim
"I've never had DTN go out on me since switching. ******* would go down a couple times every month when I was using them." - Comment from Bryce in AL.
Home  Search  Register  Login  Recent Posts

Information on DTN's Industries:
DTN Oil & Gas | DTN Trading | DTN Agriculture | DTN Weather
Follow DTNMarkets on Twitter
DTN.IQ/IQFeed on Twitter
DTN News and Analysis on Twitter
Viewing User Profile for: aQuant
About Contact
Joined: Jul 20, 2012 05:05 PM
Last Post: Oct 23, 2019 08:18 PM
Last Visit: Oct 24, 2019 09:41 PM
Website:  
Location:
Occupation:
Interests:
AIM:
ICQ:
MSN IM:
Yahoo IM:
Post Statistics
aQuant has contributed to 40 posts out of 19346 total posts (0.21%) in 2,702 days (0.01 posts per day).

20 Most recent posts:
IQFeed Datafeed Wish List » Sequential Level1 and Level2 updates. Oct 23, 2019 08:18 PM (Total replies: 1)

I requested this 5 years ago... but I understand the separation of L1 and L2 feeds is probably important and convenient organization of the feed data.

However, can we request the messages to contain a new field, message sequence ID, that comes directly from the exchange for both L1 and L2 update messages? This would allow the client to synchronize on their end. And you must be already parsing those from say CME in your data processing anyway. You could just pass them along (as optional field) to the client.
See
https://www.cmegroup.com/confluence/display/EPICSANDBOX/MDP+3.0+FIX+Tag+Library
and tag 83 message field described as:
Tag: RptSeq
FIX Type: Int
Description: MD Entry sequence number per instrument update. Reset weekly.

IQFeed Developer Wish List » Binary Protocol Sep 23, 2019 08:35 PM (Total replies: 7)

Hi Stephen,

I emailed my request to support as instructed. Thanks.

IQFeed Developer Wish List » Binary Protocol Sep 22, 2019 05:07 PM (Total replies: 7)

I agree, IQFeed developers should be able to handle binary protocol just as easily and it should be much more efficient to transfer to clients too. Especially with the hopefully coming soon (?) Market By Order depth protocol this would seem quite desirable to limit the number of bytes sent over the network.


I am using 5.2.5.0.


In the post above yours I didn't show where it began, I would have to look for that. I can try to locate it later.
I am definitely willing to supply a lot more information to anyone who will as a result help find a solution. But I would like to see some involvement of IQFeed support in this. I can help them nail this if they really want to solve it...


Based on the raw level1 messages it appears that one side stops updating, in the below case it was bid that got 'stuck' at 51.51, there may be other ways this happens, I didn't study them all:

Q,QCLH19,51.36,465114,2,51.51,51.37,1,46,183,11:19:10.391894,11321247,11:17:37.737313,11:19:10.391882,C,
Q,QCLH19,51.36,465114,2,51.51,51.37,1,47,,11:19:10.391894,11321247,11:17:37.737313,11:19:10.392009,a,
Q,QCLH19,51.36,465115,1,51.51,51.37,1,47,183,11:19:10.392111,11321248,11:17:37.737313,11:19:10.392009,C,
Q,QCLH19,51.36,465115,1,51.51,51.37,1,48,,11:19:10.392111,11321248,11:17:37.737313,11:19:10.392418,a,
Q,QCLH19,51.36,465116,1,51.51,51.37,1,48,183,11:19:10.392432,11321249,11:17:37.737313,11:19:10.392418,C,
Q,QCLH19,51.36,465117,1,51.51,51.37,1,48,183,11:19:10.392432,11321249,11:17:37.737313,11:19:10.392418,C,
Q,QCLH19,51.36,465117,1,51.51,51.37,1,49,,11:19:10.392432,11321249,11:17:37.737313,11:19:10.392538,a,
Q,QCLH19,51.36,465117,1,51.51,51.37,1,50,,11:19:10.392432,11321249,11:17:37.737313,11:19:10.392633,a,
Q,QCLH19,51.36,465117,1,51.51,51.37,1,51,,11:19:10.392432,11321249,11:17:37.737313,11:19:10.393159,a,
Q,QCLH19,51.36,465117,1,51.51,51.36,1,6,,11:19:10.392432,11321249,11:17:37.737313,11:19:10.393887,a,
Q,QCLH19,51.36,465117,1,51.51,51.36,1,7,,11:19:10.392432,11321249,11:17:37.737313,11:19:10.395510,a,
Q,QCLH19,51.36,465117,1,51.51,51.36,1,8,,11:19:10.392432,11321249,11:17:37.737313,11:19:10.395553,a,
Q,QCLH19,51.36,465117,1,51.51,51.36,1,10,,11:19:10.392432,11321249,11:17:37.737313,11:19:10.395590,a,
Q,QCLH19,51.36,465117,1,51.51,51.36,1,13,,11:19:10.392432,11321249,11:17:37.737313,11:19:10.395627,a,
Q,QCLH19,51.36,465117,1,51.51,51.36,1,14,,11:19:10.392432,11321249,11:17:37.737313,11:19:10.395727,a,
Q,QCLH19,51.36,465117,1,51.51,51.36,1,15,,11:19:10.392432,11321249,11:17:37.737313,11:19:10.395840,a,
Q,QCLH19,51.36,465117,1,51.51,51.36,1,18,,11:19:10.392432,11321249,11:17:37.737313,11:19:10.395916,a,
Q,QCLH19,51.36,465117,1,51.51,51.36,1,20,,11:19:10.392432,11321249,11:17:37.737313,11:19:10.396142,a,
Q,QCLH19,51.36,465117,1,51.51,51.36,1,22,,11:19:10.392432,11321249,11:17:37.737313,11:19:10.396215,a,
Q,QCLH19,51.36,465117,1,51.51,51.36,1,23,,11:19:10.392432,11321249,11:17:37.737313,11:19:10.396250,a,
Q,QCLH19,51.36,465117,1,51.51,51.36,1,24,,11:19:10.392432,11321249,11:17:37.737313,11:19:10.396328,a,
Q,QCLH19,51.36,465117,1,51.51,51.36,1,25,,11:19:10.392432,11321249,11:17:37.737313,11:19:10.396725,a,


It hasn't, for example today (2/11/2019) it occurred in CL, ES, 6E between 10:18-10:23am CST.

IQFeed Developer Support » Incorrect L2 data for futures Jan 29, 2019 12:27 PM (Total replies: 3)

Here is an example of a few situations from yesterday where best bid is reported above best ask (MD01 updates below). This is from 1/28/2019 CLH19 instrument.

QCLH19,MD01,52.99,52.89,4,5,01:41:26.756957,2019-01-28,52,01:41:26.757060,T,T,F,
QCLH19,MD02,52.98,52.9,10,1,01:41:26.756957,2019-01-28,52,01:41:26.757060,T,T,F,
QCLH19,MD03,52.87,52.91,57,13,01:41:26.757060,2019-01-28,52,01:41:26.757060,T,T,F,
QCLH19,MD04,52.86,52.95,67,8,01:41:26.757060,2019-01-28,52,01:41:26.757060,T,T,F,
QCLH19,MD05,52.85,52.96,70,3,01:41:26.757060,2019-01-28,52,01:41:26.757060,T,T,F,
QCLH19,MD06,52.84,52.97,53,9,01:41:26.757060,2019-01-28,52,01:41:26.757060,T,T,F,
QCLH19,MD07,52.83,52.98,90,3,01:41:26.757060,2019-01-28,52,01:41:26.757060,T,T,F,
QCLH19,MD08,52.82,52.99,81,3,01:41:26.757060,2019-01-28,52,01:41:26.757060,T,T,F,
QCLH19,MD09,52.81,53.,48,35,01:41:26.757060,2019-01-28,52,01:41:26.757060,T,T,F,
QCLH19,MD10,52.8,53.01,109,23,01:41:26.757060,2019-01-28,52,01:41:26.757060,T,T,T,
QCLH19,MD01,52.99,52.89,4,6,01:41:26.756957,2019-01-28,52,01:41:26.757075,T,T,T,


QCLH19,MD01,52.85,52.84,31,2,07:03:29.613372,2019-01-28,52,07:03:29.613372,T,T,F,
QCLH19,MD02,52.82,52.85,27,56,07:03:29.613372,2019-01-28,52,07:03:29.613372,T,T,F,
QCLH19,MD03,52.81,52.86,55,33,07:03:29.613372,2019-01-28,52,07:03:29.613372,T,T,F,
QCLH19,MD04,52.8,52.87,50,42,07:03:29.613372,2019-01-28,52,07:03:29.613372,T,T,F,
QCLH19,MD05,52.79,52.88,36,26,07:03:29.613372,2019-01-28,52,07:03:29.613372,T,T,F,
QCLH19,MD06,52.78,52.89,40,31,07:03:29.613372,2019-01-28,52,07:03:29.613372,T,T,F,
QCLH19,MD07,52.77,52.9,38,70,07:03:29.613372,2019-01-28,52,07:03:29.613372,T,T,F,
QCLH19,MD08,52.76,52.91,34,31,07:03:29.613372,2019-01-28,52,07:03:29.613372,T,T,F,
QCLH19,MD09,52.75,52.92,47,42,07:03:29.613372,2019-01-28,52,07:03:29.613372,T,T,F,
QCLH19,MD10,52.74,52.93,37,47,07:03:29.613372,2019-01-28,52,07:03:29.613372,T,T,T,
QCLH19,MD02,52.82,52.85,27,6,07:03:29.613372,2019-01-28,52,07:03:29.613386,T,T,F,
QCLH19,MD03,52.81,52.86,55,22,07:03:29.613372,2019-01-28,52,07:03:29.613386,T,T,T,
QCLH19,MD03,52.81,52.86,55,4,07:03:29.613372,2019-01-28,52,07:03:29.613403,T,T,T,

QCLH19,MD01,52.42,52.41,3,2,09:07:55.677653,2019-01-28,52,09:07:55.677684,T,T,F,
QCLH19,MD02,52.41,52.43,10,15,09:07:55.677676,2019-01-28,52,09:07:55.677684,T,T,F,
QCLH19,MD03,52.39,52.44,37,45,09:07:55.677684,2019-01-28,52,09:07:55.677684,T,T,F,
QCLH19,MD04,52.38,52.45,61,41,09:07:55.677684,2019-01-28,52,09:07:55.677684,T,T,F,
QCLH19,MD05,52.37,52.46,41,49,09:07:55.677684,2019-01-28,52,09:07:55.677684,T,T,F,
QCLH19,MD06,52.36,52.47,60,46,09:07:55.677684,2019-01-28,52,09:07:55.677684,T,T,F,
QCLH19,MD07,52.35,52.48,98,42,09:07:55.677684,2019-01-28,52,09:07:55.677684,T,T,F,
QCLH19,MD08,52.34,52.49,40,33,09:07:55.677684,2019-01-28,52,09:07:55.677684,T,T,F,
QCLH19,MD09,52.33,52.5,47,37,09:07:55.677684,2019-01-28,52,09:07:55.677684,T,T,F,
QCLH19,MD10,52.32,52.51,62,24,09:07:55.677684,2019-01-28,52,09:07:55.677684,T,T,T,

IQFeed Developer Support » Incorrect L2 data for futures Jan 28, 2019 09:31 AM (Total replies: 3)

Yes, I am aware of the Bid/AskInfoValid flag. Note this line though:

QCLH19,MD10,53.05,54.27,90,14,06:01:44.162620,2019-01-22,52,06:01:44.162620,T,T,T,

which indicates end of group updates. It still has the 54.27 ask (this time all are flagged valid). This ask is definitely not valid, about 100 ticks off of correct price.

IQFeed Developer Support » Incorrect L2 data for futures Jan 26, 2019 10:36 PM (Total replies: 3)

I often see incorrect/nonsensical L2 data right after a large trade takes out a few levels on the DOM (depth of market). For example, this is from CLH9 1/22/2019 at 06:01.44.16260am EST the ask price is off by almost hundred ticks for a few updates in a row. Then at 06:01:44.162895 it 'comes back' to normal.

I have other examples, where crossed bid/ask MD0x levels are reported for a number of updates (typically following a trade that sweeps a few levels). Is this something that can be fixed?

QCLH19,MD01,53.13,53.15,10,18,06:01:44.162613,2019-01-22,52,06:01:44.021207,T,T,F,
QCLH19,MD02,53.12,53.16,34,25,06:01:44.162613,2019-01-22,52,06:01:43.970119,T,T,F,
QCLH19,MD03,53.11,53.17,54,22,06:01:44.162613,2019-01-22,52,06:01:43.970383,T,T,F,
QCLH19,MD04,53.1,53.18,76,28,06:01:44.162613,2019-01-22,52,06:01:43.883353,T,T,F,
QCLH19,MD05,53.09,53.19,32,28,06:01:44.162613,2019-01-22,52,06:01:43.874302,T,T,F,
QCLH19,MD06,53.08,53.2,37,22,06:01:44.162613,2019-01-22,52,06:01:44.011207,T,T,F,
QCLH19,MD07,53.07,53.21,80,23,06:01:44.162613,2019-01-22,52,06:01:44.037856,T,T,F,
QCLH19,MD08,53.06,53.22,38,29,06:01:44.162613,2019-01-22,52,06:01:44.037856,T,T,F,
QCLH19,MD09,53.05,53.23,90,18,06:01:44.162613,2019-01-22,52,06:01:43.874302,T,T,F,
QCLH19,MD10,53.04,53.24,39,24,06:01:44.162613,2019-01-22,52,06:01:43.874302,T,T,T,
QCLH19,MD01,54.18,54.18,0,3886,06:01:44.162620,2019-01-22,52,06:01:44.162620,F,T,F,
QCLH19,MD02,53.13,54.19,10,9,06:01:44.162620,2019-01-22,52,06:01:44.162620,T,T,F,
QCLH19,MD03,53.12,54.2,10,23,06:01:44.162620,2019-01-22,52,06:01:44.162620,T,T,F,
QCLH19,MD04,53.11,54.21,41,26,06:01:44.162620,2019-01-22,52,06:01:44.162620,T,T,F,
QCLH19,MD05,53.1,54.22,76,15,06:01:44.162620,2019-01-22,52,06:01:44.162620,T,T,F,
QCLH19,MD06,53.09,54.23,32,14,06:01:44.162620,2019-01-22,52,06:01:44.162620,T,T,F,
QCLH19,MD07,53.08,54.24,37,8,06:01:44.162620,2019-01-22,52,06:01:44.162620,T,T,F,
QCLH19,MD08,53.07,54.25,80,22,06:01:44.162620,2019-01-22,52,06:01:44.162620,T,T,F,
QCLH19,MD09,53.06,54.26,38,8,06:01:44.162620,2019-01-22,52,06:01:44.162620,T,T,F,
QCLH19,MD10,53.05,54.27,90,14,06:01:44.162620,2019-01-22,52,06:01:44.162620,T,T,T,
QCLH19,MD01,53.11,53.12,49,19,06:01:44.162895,2019-01-22,52,06:01:44.162895,T,T,F,
QCLH19,MD02,53.1,53.13,95,1,06:01:44.162895,2019-01-22,52,06:01:44.162895,T,T,F,
QCLH19,MD03,53.09,53.15,32,18,06:01:44.162895,2019-01-22,52,06:01:44.162895,T,T,F,
QCLH19,MD04,53.08,53.16,37,25,06:01:44.162895,2019-01-22,52,06:01:44.162895,T,T,F,
QCLH19,MD05,53.07,53.17,80,22,06:01:44.162895,2019-01-22,52,06:01:44.162895,T,T,F,
QCLH19,MD06,53.06,53.18,38,28,06:01:44.162895,2019-01-22,52,06:01:44.162895,T,T,F,
QCLH19,MD07,53.05,53.19,90,28,06:01:44.162895,2019-01-22,52,06:01:44.162895,T,T,F,
QCLH19,MD08,53.04,53.2,39,22,06:01:44.162895,2019-01-22,52,06:01:44.162895,T,T,F,
QCLH19,MD09,53.03,53.21,55,23,06:01:44.162895,2019-01-22,52,06:01:44.162895,T,T,F,
QCLH19,MD10,53.02,53.22,48,29,06:01:44.162895,2019-01-22,52,06:01:44.162895,T,T,T,


Today was particularly bad, CL and currency data (CL, 6E, 6A,6J) all had this issue for hours after 9:31am central time.


I have been seeing invalid and stale market data in various insturments (CL, ES) in the last month or so (could be slightly longer). It occurs at seemingly random times and usually lasts about 10 minutes sometimes up to an hour.
Example from today: 10:08-10:20am, 3:05-3:15pm CST in ES. Here is a snapshot of L1 updates from one of the periods:

Q,@ESZ18,2738.25,3859981,2,2738.00,2733.75,64,1,183,16:08:31.779471,271740673,16:08:31.770457,16:05:00.164499,C,
Q,@ESZ18,2738.25,3859982,1,2738.00,2733.75,64,1,183,16:08:31.779471,271740673,16:08:31.770457,16:05:00.164499,C,
Q,@ESZ18,2738.25,3859983,1,2738.00,2733.75,64,1,183,16:08:31.779471,271740673,16:08:31.770457,16:05:00.164499,C,
Q,@ESZ18,2738.25,3859984,1,2738.00,2733.75,64,1,183,16:08:31.779471,271740673,16:08:31.770457,16:05:00.164499,C,
Q,@EDU20,96.7650,270309,2,96.7650,96.7700,8665,15942,,16:07:28.306149,9268532,16:08:31.734942,16:08:31.768035,a,
Q,@EDM19,96.9800,405656,2,96.9800,96.9850,7411,30599,,16:00:00.036589,9268244,16:08:31.753186,16:08:31.768255,a,
Q,@EDU20,96.7650,270309,2,96.7650,96.7700,8665,15824,,16:07:28.306149,9268532,16:08:31.734942,16:08:31.768255,a,
Q,@EDH20,96.7650,342864,2,96.7650,96.7700,4985,27436,,16:07:28.306149,9268541,16:08:31.734935,16:08:31.768255,a,
Q,@EDM20,96.7600,348765,3,96.7600,96.7650,6401,20909,,16:07:28.306149,9268536,16:08:31.733403,16:08:31.768255,a,
Q,@ESZ18,2738.25,3859984,1,2738.25,2733.75,13,1,,16:08:31.779471,271740673,16:08:31.779481,16:05:00.164499,b,
Q,@ESZ18,2738.25,3859984,1,2738.25,2733.75,14,1,,16:08:31.779471,271740673,16:08:31.779658,16:05:00.164499,b,
Q,@ESZ18,2738.25,3859984,1,2738.25,2733.75,15,1,,16:08:31.779471,271740673,16:08:31.779676,16:05:00.164499,b,

In the above (and with my message structure) the best bid/ask data are crossed and indicating 2738.25,2733.75 for bid and ask for ES, clearly nonsensical. This same stale/invalid bid/ask info stays such for the period in question. Notice that ED above (eurodollar) is just fine as are most other contracts. This has been happening for over a month and I alerted iqfeed support to it. Initially they expressed it was due to testing MBO feed. When I contended those reasons they claimed they had some issues with CME feed. Whatever it is, this is not getting fixed and I am concerned this is not getting the priority it deserves. Any advanced developer depends on full/complete/correct data-as the feed proclaims to provide. Please correct this issue. I can provide more details if needed.


Is anyone looking into this? Looking in the past (year 2015 for example), this problem used to affect more securities but now seems to only linger still in treasury futures.


Some level2 updates are being transmitted with missing digits, resulting in non-tradable prices for US Treasury futures (cme-globex). Here is a snapshot of data 4/30/2018 data with times being EST (iqfeed original binary data)
Z,@TYM18,MD02,119.4062,119.4531,2728,2948,02:57:47.063273,2018-04-30,52,02:58:05.033101,T,T,T,
Z,@TYM18,MD10,119.2812,119.5781,2686,2938,02:56:56.026410,2018-04-30,52,02:55:53.000703,T,T,T,
Z,@TYM18,MD07,119.3281,119.5312,3073,3010,02:55:53.000854,2018-04-30,52,02:55:53.000668,T,T,T,
Z,@TYM18,MD04,119.375,119.4844,4011,3183,02:58:02.013251,2018-04-30,52,02:55:53.000627,T,T,T,
Z,@TYM18,MD09,119.2969,119.5625,3105,4493,02:55:55.026573,2018-04-30,52,02:55:53.000691,T,T,T,
Z,@TYM18,MD01,119.4219,119.4375,1720,353,02:58:03.012086,2018-04-30,52,02:58:07.060752,T,T,T,
Z,@TYM18,MD06,119.3438,119.5156,2837,3079,02:57:19.030662,2018-04-30,52,02:55:53.000648,T,T,T,

119.4062 is not a tradable price, 119.40625 is (the 5th decimal digit is missing in the above update)
I am attaching a file from 4/30/2018 with the following structure:
cme ticker, timestamp in CST (hh:mm:ss.fffffff-to a tenth of a microsecond), bid,ask, depth (where depth is zero based, i.e. 2 means MD03 update in iqfeed terms). I scanned data from 1/1/2018-4/30/2018 and this happens daily. I can provide a full list of instances with times similar to the attached file.


Almost 2 years later, any update on this topic? Is this still on your roadmap, any closer? Thank you.


Is there any update on the above? Was it internally discussed? What is the conclusion? Thank you.


Thank you. I did send an email. I think this feature is catering to advanced audience-but the more precious for those knowing how to use the information. It would be very valuable to have it.


I would like to receive order count in addition to the already available price/quantity information for Level2 data as shown here:
http://www.cmegroup.com/confluence/display/EPICSANDBOX/Market+Data+-+Multiple+Depth+Book
It should be very easy to implement and you are already getting the data from CME, just a matter of passing it on to users. Please let me know your thoughts. Thank you.

IQFeed Developer Support » CME protocol May 5, 2015 01:48 PM (Total replies: 28)

Actually, apologize to bother you. I have found the link, here it is for those interested:

http://www.cmegroup.com/confluence/display/EPICSANDBOX/MDP+3.0+-+Trade+Summary

IQFeed Developer Support » CME protocol May 5, 2015 01:11 PM (Total replies: 28)

CME documents bundling somewhat in their documentation of MDP3, it's not detailed enough however. Could you shed light (very briefly) on how they bundle those trades in the new protocol?


Time: Thu December 12, 2019 2:56 PM CFBB v1.2.0 47 ms.
© AderSoftware 2002-2003