Join the 80,000 other DTN customers who enjoy the fastest, most reliable data available. There is no better value than DTN!

(Move your cursor to this area to pause scrolling)




"And by the way, have to say this. I love the IQFeed software. It's rock solid and it has a really nice API." - Comment from Thomas via RT Chat
"Thanks for all of your help. Great customer service deserves to be recognized which one the reasons I've been a customer of DTN for over 10 years!" - Comment from Stuart
"I used to have *******, but they are way more money for the same thing. I have had no probs with data from DTN since switching over." - Comment from Public Forum Post
"I've been using Neoticker RT with IQFeed for two months, and I'm very happy with both of the products (I've had IQFeed for two years with very few complaints). The service from both companies is exceptional." - Comment from Public Forum
"I'm very glad I switched to IQFeed. It's working perfectly with no lag, even during fast market conditions." - Comment from Andy via Email
"Thank God for your Data Feed as the only Zippers I see are on my pants (LOL), and no more 200 pip spikes to mess up charts." - Comment from Spiro via Email
"After all the anxiety I had with my previous data provider it is a relief not to have to worry about data speed and integrity." - Comment from Eamonn
"It’s so nice to be working with real professionals!" - Comment from Len
"I am very happy I changed. I love the product, but more so I am thrilled with Tech Support. You are knowledgeable, polite, pleasant and professional." - Comment from Pat
"If you are serious about your trading I would not rely on IB data for serious daytrading. Took me a while to justify the cost of IQ Feed and in the end, it's just a 2 point stop on ES. Better safe than sorry" - Comment from Public Forum
Home  Search  Register  Login  Recent Posts

Information on DTN's Industries:
DTN Oil & Gas | DTN Trading | DTN Agriculture | DTN Weather
Follow DTNMarkets on Twitter
DTN.IQ/IQFeed on Twitter
DTN News and Analysis on Twitter
»Forums Index »Product Support »Data and Content Support »Understanding Historical Tick Data
Author Topic: Understanding Historical Tick Data (6 messages, Page 1 of 1)

Ryan
-Interested User-
Posts: 14
Joined: May 17, 2012


Posted: Sep 24, 2014 11:57 AM          Msg. 1 of 6
I'm using HTD to request tick data on SPY. I've copied a continuous portion below:

2014-09-23 09:30:00,198.4300,100,4601873,198.4300,198.4300,4305,0,0,C
2014-09-23 09:30:00,198.4400,100,4601973,198.4300,198.4300,4306,0,0,C
2014-09-23 09:30:00,198.4100,333382,4935355,198.4200,198.4300,4318,0,0,C
2014-09-23 09:30:00,198.4300,500,4935855,198.4200,198.4300,4321,0,0,E
2014-09-23 09:30:00,198.4300,500,4936355,198.4200,198.4300,4322,0,0,E
2014-09-23 09:30:00,198.4300,500,4936855,198.4200,198.4300,4323,0,0,E
2014-09-23 09:30:00,198.4300,500,4937355,198.4200,198.4300,4324,0,0,E
2014-09-23 09:30:00,198.4400,100,4937484,198.4200,198.4300,4326,0,0,C
2014-09-23 09:30:00,198.4400,200,4937684,198.4200,198.4300,4327,0,0,C


1. TickID on line 2 is 4306 and on line 3 in 4318. However, the Last Size on line 3 equals the change in the Total Volume between lines 2 & 3. So is this an aggregation of trades? If so, how is it determined that those trades should be aggregated.


2. Between lines 7 & 8 TickID 4325 is missing and the volume is not accounted for. The Total Volume increased by 129 between lines 7 & 8, but the Last Size in line 8 is 100. TickID 4325 is not in the rest of that day's data.

a. I've seen terms "implied trade" / "non-last-qualifying" used elsewhere in this forum, but I'm not sure how/if "implied trade" applies to equities and I really can't find the term "non-last-qualifying" outside of iqfeed. If this is the reason for the unaccounted for volume above, can you direct to a more substantial definition of "non-last-qualifying" (an exchange generated document perhaps)?

b. If I was watching / recording SPY in real-time, would I find these 29 shares with a TickID of 4325?


Much appreciated,
Ryan

DTN_LorenF
-DTN Technical Support-
Posts: 228
Joined: May 11, 2004


Posted: Sep 24, 2014 12:58 PM          Msg. 2 of 6
Ryan

I have attached a png file to this posting which shows the time stamps/tick ID/info/mkt center/trade conditions.

I hope this answers your question.



File Attached: Capture1.PNG (downloaded 1160 times)

DTN_Steve_S
-DTN Guru-
Posts: 2093
Joined: Nov 21, 2005


Posted: Sep 25, 2014 11:00 AM          Msg. 3 of 6
Expanding on Loren's answer, tickIDs are not guaranteed to be sequential or even always increasing. They are only guaranteed to be unique per symbol per day. In most cases (whenever available), these are provided by the exchange and are intended to be used only as a unique trade identifier so they can't reliably be used as an indicator of missing data.

Loren's email gives you a more complete picture of the actual trade information available in the newer IQFeed protocols (see the API docs for information on switching to the new protocol). As you can see in that screenshot, Line 3 from your data corresponds to the Opening trade received from NYSE_ARCA. We have verified that the volume of this open trade is what we received from the exchange. Unfortunately, we do not know exactly what that volume represents but I would guess you are correct that it is an aggregation of some kind of orders at NYSE_ARCA. Our market data group has sent a request for more information about this from the exchange but I can't guarantee we will get anymore information from them (we will let you know if we do).

Also in Loren's screenshot, you can see the "Other Trade" of volume 29 which accounts for the missing volume from your data. Trades are generally categorized by the exchanges in 2 categories, Last-Qualifying and Non-Last Qualifying and the different is exactly what it sounds like (A non-Last-qualified trade will not set the "Last" price). At DTN, we go one step further and break up the non-last-qualified trades into 2 categories as well, Extended Trades, and Other Trades. The reasoning for this is that some non-last-qualified trades (specifically FormT trades) account for the vast majority of pre/post market ("Extended") trading and are generally inline with the last qualified trades in terms of pricing and trends. All other non-last-qualified trades ("Other Trades") have wide swings in prices that will cause charts to look bad and throw off analytics.

Here are a couple references to exchange documentation concerning this as you requested:
http://nasdaqtrader.com/content/technicalsupport/specifications/utp/utdfspecification.pdf
7.5.1.1. UTP Trade Condition Matrix

https://cta.nyxdata.com/cta/document/5944/2f76d73065c5d0f9629eb576302adc1da66d1f9f
Page 113

Let us know if you have additional questions.

jonnyb
-DTN Evangelist-
Posts: 116
Joined: Aug 15, 2012


Posted: Jul 18, 2015 08:24 AM          Msg. 4 of 6
Quote: Ryan

I have attached a png file to this posting which shows the time stamps/tick ID/info/mkt center/trade conditions.

I hope this answers your question.
--- Original message by DTN_LorenF on Sep 24, 2014 12:58 PM
Loren- Is the app in your screenshot an updated HistoryViewer? I only seem to have the one with the hex codes (pain in the butt). Thanks.

DTN_Tim Walter
-DTN Guru-
Posts: 1238
Joined: Apr 25, 2006


Posted: Jul 20, 2015 06:26 AM          Msg. 5 of 6
That screenshot is from the DTN.IQ software. But, I'll make a note that adding a name column for trade conditions would be helpful in the history viewer.

Tim

jonnyb
-DTN Evangelist-
Posts: 116
Joined: Aug 15, 2012


Posted: Jul 20, 2015 08:54 AM          Msg. 6 of 6
Thanks Tim
 

 

Time: Wed July 17, 2019 9:47 AM CFBB v1.2.0 31 ms.
© AderSoftware 2002-2003