Join the 80,000 other DTN customers who enjoy the fastest, most reliable data available. There is no better value than DTN!

(Move your cursor to this area to pause scrolling)




"You are either overstaffed or people just don't have problems with your feed because customer support always answers the phone quickly." - Comment from Jay via Email
"After all the anxiety I had with my previous data provider it is a relief not to have to worry about data speed and integrity." - Comment from Eamonn
"Thanks for all of your help. Great customer service deserves to be recognized which one the reasons I've been a customer of DTN for over 10 years!" - Comment from Stuart
"DTN feed was the only feed that consistently matched Bloomberg feed for BID/ASK data verification work these past years......DTN feed is a must for my supply & demand based trading using Cumulative Delta" - Comment from Public Forum Post
"You have an excellent product !!!!!!" - Comment from Arely
"I ran your IQFeed DDE vs. my broker vs. a level II window for some slow-moving options. I would see the level II quote change, then your feed update instantaneously. My broker's DDE, however, would take as much as 30 seconds to update. I am not chasing milliseconds, but half a minute is unacceptable." - Comment from Rob
"Previously I was using *******. IQFeed is WAY more economical, and for my charting needs is just as good, if not better." - Comment from Public Forum Post
"Its working FABULOUSLY for me!! Holy cow...there has been so much I've been missing lately, and with this feed and Linnsoft software...I'm in the game now." - Comment from Chris R.
"IQFeed version 4 is a real screamer compared to anything else I have seen." - Comment from Tom
"IQ feed is brilliant. The support is mind-bending. What service!" - Comment from Public Forum Post
Home  Search  Register  Login  Blogs Recent Posts

Information on DTN's Industries:
DTN Oil & Gas | DTN Trading | DTN Agriculture | DTN Weather
Follow DTN_IQFeed on Twitter
DTN.IQ/IQFeed on Twitter
DTN News and Analysis on Twitter
»Forums Index »Product Support »Data and Content Support »Understanding Historical Tick Data
Author Topic: Understanding Historical Tick Data (6 messages, Page 1 of 1)

Ryan
-Interested User-
Posts: 14
Joined: May 17, 2012


Posted: Sep 24, 2014 11:57 AM          Msg. 1 of 6
I'm using HTD to request tick data on SPY. I've copied a continuous portion below:

2014-09-23 09:30:00,198.4300,100,4601873,198.4300,198.4300,4305,0,0,C
2014-09-23 09:30:00,198.4400,100,4601973,198.4300,198.4300,4306,0,0,C
2014-09-23 09:30:00,198.4100,333382,4935355,198.4200,198.4300,4318,0,0,C
2014-09-23 09:30:00,198.4300,500,4935855,198.4200,198.4300,4321,0,0,E
2014-09-23 09:30:00,198.4300,500,4936355,198.4200,198.4300,4322,0,0,E
2014-09-23 09:30:00,198.4300,500,4936855,198.4200,198.4300,4323,0,0,E
2014-09-23 09:30:00,198.4300,500,4937355,198.4200,198.4300,4324,0,0,E
2014-09-23 09:30:00,198.4400,100,4937484,198.4200,198.4300,4326,0,0,C
2014-09-23 09:30:00,198.4400,200,4937684,198.4200,198.4300,4327,0,0,C


1. TickID on line 2 is 4306 and on line 3 in 4318. However, the Last Size on line 3 equals the change in the Total Volume between lines 2 & 3. So is this an aggregation of trades? If so, how is it determined that those trades should be aggregated.


2. Between lines 7 & 8 TickID 4325 is missing and the volume is not accounted for. The Total Volume increased by 129 between lines 7 & 8, but the Last Size in line 8 is 100. TickID 4325 is not in the rest of that day's data.

a. I've seen terms "implied trade" / "non-last-qualifying" used elsewhere in this forum, but I'm not sure how/if "implied trade" applies to equities and I really can't find the term "non-last-qualifying" outside of iqfeed. If this is the reason for the unaccounted for volume above, can you direct to a more substantial definition of "non-last-qualifying" (an exchange generated document perhaps)?

b. If I was watching / recording SPY in real-time, would I find these 29 shares with a TickID of 4325?


Much appreciated,
Ryan

DTN_LorenF
-DTN Technical Support-
Posts: 228
Joined: May 11, 2004


Posted: Sep 24, 2014 12:58 PM          Msg. 2 of 6
Ryan

I have attached a png file to this posting which shows the time stamps/tick ID/info/mkt center/trade conditions.

I hope this answers your question.



File Attached: Capture1.PNG (downloaded 994 times)

DTN_Steve_S
-DTN Guru-
Posts: 2051
Joined: Nov 21, 2005


Posted: Sep 25, 2014 11:00 AM          Msg. 3 of 6
Expanding on Loren's answer, tickIDs are not guaranteed to be sequential or even always increasing. They are only guaranteed to be unique per symbol per day. In most cases (whenever available), these are provided by the exchange and are intended to be used only as a unique trade identifier so they can't reliably be used as an indicator of missing data.

Loren's email gives you a more complete picture of the actual trade information available in the newer IQFeed protocols (see the API docs for information on switching to the new protocol). As you can see in that screenshot, Line 3 from your data corresponds to the Opening trade received from NYSE_ARCA. We have verified that the volume of this open trade is what we received from the exchange. Unfortunately, we do not know exactly what that volume represents but I would guess you are correct that it is an aggregation of some kind of orders at NYSE_ARCA. Our market data group has sent a request for more information about this from the exchange but I can't guarantee we will get anymore information from them (we will let you know if we do).

Also in Loren's screenshot, you can see the "Other Trade" of volume 29 which accounts for the missing volume from your data. Trades are generally categorized by the exchanges in 2 categories, Last-Qualifying and Non-Last Qualifying and the different is exactly what it sounds like (A non-Last-qualified trade will not set the "Last" price). At DTN, we go one step further and break up the non-last-qualified trades into 2 categories as well, Extended Trades, and Other Trades. The reasoning for this is that some non-last-qualified trades (specifically FormT trades) account for the vast majority of pre/post market ("Extended") trading and are generally inline with the last qualified trades in terms of pricing and trends. All other non-last-qualified trades ("Other Trades") have wide swings in prices that will cause charts to look bad and throw off analytics.

Here are a couple references to exchange documentation concerning this as you requested:
http://nasdaqtrader.com/content/technicalsupport/specifications/utp/utdfspecification.pdf
7.5.1.1. UTP Trade Condition Matrix

https://cta.nyxdata.com/cta/document/5944/2f76d73065c5d0f9629eb576302adc1da66d1f9f
Page 113

Let us know if you have additional questions.

jonnyb
-DTN Evangelist-
Posts: 112
Joined: Aug 15, 2012


Posted: Jul 18, 2015 08:24 AM          Msg. 4 of 6
Quote: Ryan

I have attached a png file to this posting which shows the time stamps/tick ID/info/mkt center/trade conditions.

I hope this answers your question.
--- Original message by DTN_LorenF on Sep 24, 2014 12:58 PM
Loren- Is the app in your screenshot an updated HistoryViewer? I only seem to have the one with the hex codes (pain in the butt). Thanks.

DTN_Tim Walter
-DTN Guru-
Posts: 1238
Joined: Apr 25, 2006


Posted: Jul 20, 2015 06:26 AM          Msg. 5 of 6
That screenshot is from the DTN.IQ software. But, I'll make a note that adding a name column for trade conditions would be helpful in the history viewer.

Tim

jonnyb
-DTN Evangelist-
Posts: 112
Joined: Aug 15, 2012


Posted: Jul 20, 2015 08:54 AM          Msg. 6 of 6
Thanks Tim
 

 

Time: Thu November 15, 2018 6:36 AM CFBB v1.2.0 16 ms.
© AderSoftware 2002-2003