Join the 80,000 other DTN customers who enjoy the fastest, most reliable data available. There is no better value than DTN!

(Move your cursor to this area to pause scrolling)




"Boy, probably spent a thousand hours trying to get ******* API to work right. And now two hours to have something running with IQFeed. Hmmm, guess I was pretty stupid to fight rather than switch all this time. And have gotten more customer service from you guys already than total from them… in five years." - Comment from Jim
"I am keeping IQFeed, much better reliabilty than *******. I may refer a few other people in the office to switch as well." - Comment from Don
"Excellent datafeed !!!" - Comment from Arely
"I am very happy I changed. I love the product, but more so I am thrilled with Tech Support. You are knowledgeable, polite, pleasant and professional." - Comment from Pat
"The service is great, I see a noticeable improvement in my volume profiles over [broker]'s data feed" - Comment from Larry
"I just wanted to let u know that your data feed/service is by far the best!!! Your unfiltered tick data is excellent for reading order flow and none of your competitors delivers this quality of data!" - Comment from Peter via Email
"Everything is working great ! Very impressive client. The news refreshes better and is more pertinent than the ******* feed I paid $ 100/month for. I Also like the charts a lot." - Comment from Leon
"Just a quick one to say I'm very impressed so far :) The documentation for developers is excellent and I've quickly managed to get an app written to do historical downloads. The system is very robust and pretty quick considering the extent of data that's available. The support guys have been very helpful too, in combination with the forums it's been plain sailing so far!" - Comment from Adam
"IQFeed version 4 is a real screamer compared to anything else I have seen." - Comment from Tom
"It’s so nice to be working with real professionals!" - Comment from Len
Home  Search  Register  Login  Blogs Recent Posts

Information on DTN's Industries:
DTN Oil & Gas | DTN Trading | DTN Agriculture | DTN Weather
Follow DTN_IQFeed on Twitter
DTN.IQ/IQFeed on Twitter
DTN News and Analysis on Twitter
»Forums Index »Product Support »Data and Content Support »Understanding Historical Tick Data
Author Topic: Understanding Historical Tick Data (6 messages, Page 1 of 1)

Ryan
-Interested User-
Posts: 14
Joined: May 17, 2012


Posted: Sep 24, 2014 11:57 AM          Msg. 1 of 6
I'm using HTD to request tick data on SPY. I've copied a continuous portion below:

2014-09-23 09:30:00,198.4300,100,4601873,198.4300,198.4300,4305,0,0,C
2014-09-23 09:30:00,198.4400,100,4601973,198.4300,198.4300,4306,0,0,C
2014-09-23 09:30:00,198.4100,333382,4935355,198.4200,198.4300,4318,0,0,C
2014-09-23 09:30:00,198.4300,500,4935855,198.4200,198.4300,4321,0,0,E
2014-09-23 09:30:00,198.4300,500,4936355,198.4200,198.4300,4322,0,0,E
2014-09-23 09:30:00,198.4300,500,4936855,198.4200,198.4300,4323,0,0,E
2014-09-23 09:30:00,198.4300,500,4937355,198.4200,198.4300,4324,0,0,E
2014-09-23 09:30:00,198.4400,100,4937484,198.4200,198.4300,4326,0,0,C
2014-09-23 09:30:00,198.4400,200,4937684,198.4200,198.4300,4327,0,0,C


1. TickID on line 2 is 4306 and on line 3 in 4318. However, the Last Size on line 3 equals the change in the Total Volume between lines 2 & 3. So is this an aggregation of trades? If so, how is it determined that those trades should be aggregated.


2. Between lines 7 & 8 TickID 4325 is missing and the volume is not accounted for. The Total Volume increased by 129 between lines 7 & 8, but the Last Size in line 8 is 100. TickID 4325 is not in the rest of that day's data.

a. I've seen terms "implied trade" / "non-last-qualifying" used elsewhere in this forum, but I'm not sure how/if "implied trade" applies to equities and I really can't find the term "non-last-qualifying" outside of iqfeed. If this is the reason for the unaccounted for volume above, can you direct to a more substantial definition of "non-last-qualifying" (an exchange generated document perhaps)?

b. If I was watching / recording SPY in real-time, would I find these 29 shares with a TickID of 4325?


Much appreciated,
Ryan

DTN_LorenF
-DTN Technical Support-
Posts: 228
Joined: May 11, 2004


Posted: Sep 24, 2014 12:58 PM          Msg. 2 of 6
Ryan

I have attached a png file to this posting which shows the time stamps/tick ID/info/mkt center/trade conditions.

I hope this answers your question.



File Attached: Capture1.PNG (downloaded 1042 times)

DTN_Steve_S
-DTN Guru-
Posts: 2064
Joined: Nov 21, 2005


Posted: Sep 25, 2014 11:00 AM          Msg. 3 of 6
Expanding on Loren's answer, tickIDs are not guaranteed to be sequential or even always increasing. They are only guaranteed to be unique per symbol per day. In most cases (whenever available), these are provided by the exchange and are intended to be used only as a unique trade identifier so they can't reliably be used as an indicator of missing data.

Loren's email gives you a more complete picture of the actual trade information available in the newer IQFeed protocols (see the API docs for information on switching to the new protocol). As you can see in that screenshot, Line 3 from your data corresponds to the Opening trade received from NYSE_ARCA. We have verified that the volume of this open trade is what we received from the exchange. Unfortunately, we do not know exactly what that volume represents but I would guess you are correct that it is an aggregation of some kind of orders at NYSE_ARCA. Our market data group has sent a request for more information about this from the exchange but I can't guarantee we will get anymore information from them (we will let you know if we do).

Also in Loren's screenshot, you can see the "Other Trade" of volume 29 which accounts for the missing volume from your data. Trades are generally categorized by the exchanges in 2 categories, Last-Qualifying and Non-Last Qualifying and the different is exactly what it sounds like (A non-Last-qualified trade will not set the "Last" price). At DTN, we go one step further and break up the non-last-qualified trades into 2 categories as well, Extended Trades, and Other Trades. The reasoning for this is that some non-last-qualified trades (specifically FormT trades) account for the vast majority of pre/post market ("Extended") trading and are generally inline with the last qualified trades in terms of pricing and trends. All other non-last-qualified trades ("Other Trades") have wide swings in prices that will cause charts to look bad and throw off analytics.

Here are a couple references to exchange documentation concerning this as you requested:
http://nasdaqtrader.com/content/technicalsupport/specifications/utp/utdfspecification.pdf
7.5.1.1. UTP Trade Condition Matrix

https://cta.nyxdata.com/cta/document/5944/2f76d73065c5d0f9629eb576302adc1da66d1f9f
Page 113

Let us know if you have additional questions.

jonnyb
-DTN Evangelist-
Posts: 112
Joined: Aug 15, 2012


Posted: Jul 18, 2015 08:24 AM          Msg. 4 of 6
Quote: Ryan

I have attached a png file to this posting which shows the time stamps/tick ID/info/mkt center/trade conditions.

I hope this answers your question.
--- Original message by DTN_LorenF on Sep 24, 2014 12:58 PM
Loren- Is the app in your screenshot an updated HistoryViewer? I only seem to have the one with the hex codes (pain in the butt). Thanks.

DTN_Tim Walter
-DTN Guru-
Posts: 1238
Joined: Apr 25, 2006


Posted: Jul 20, 2015 06:26 AM          Msg. 5 of 6
That screenshot is from the DTN.IQ software. But, I'll make a note that adding a name column for trade conditions would be helpful in the history viewer.

Tim

jonnyb
-DTN Evangelist-
Posts: 112
Joined: Aug 15, 2012


Posted: Jul 20, 2015 08:54 AM          Msg. 6 of 6
Thanks Tim
 

 

Time: Tue January 22, 2019 10:50 AM CFBB v1.2.0 16 ms.
© AderSoftware 2002-2003