Join the 80,000 other DTN customers who enjoy the fastest, most reliable data available. There is no better value than DTN!

(Move your cursor to this area to pause scrolling)




"DTN has never given me problems. It is incredibly stable. In fact I've occasionally lost the data feed from Interactive Brokers, but still been able to trade because I'm getting good data from DTN." - Comment from Leighton
"I will tell others who want to go into trading that DTN ProphetX is an invaluable tool, I don't think anyone can trade without it..." - Comment from Luther
"Its working FABULOUSLY for me!! Holy cow...there has been so much I've been missing lately, and with this feed and Linnsoft software...I'm in the game now." - Comment from Chris R.
"This beats the pants off CQG, I am definitely switching to the ProphetX 3.0!" - Comment from Stephen
"I am enjoying the feed very much - so superior to the broker provided feed I was previously using." - Comment from George
"You are much better than lawyers or the phone company because you answer the phone when I call! I just love your customer service." - Comment from Isreal
"I ran your IQFeed DDE vs. my broker vs. a level II window for some slow-moving options. I would see the level II quote change, then your feed update instantaneously. My broker's DDE, however, would take as much as 30 seconds to update. I am not chasing milliseconds, but half a minute is unacceptable." - Comment from Rob
"I am very pleased with the DTNIQ system for quotes and news." - Comment from Larry
"I am very happy I changed. I love the product, but more so I am thrilled with Tech Support. You are knowledgeable, polite, pleasant and professional." - Comment from Pat
"There is no doubt that IQFeed is the best data provider. I am very satisfied with your services. And IQFeed is the only one that I would recommend to my friends. Now, most of them are using your product in China." - Comment from Zhezhe
Home  Search  Register  Login  Recent Posts

Information on DTN's Industries:
DTN Oil & Gas | DTN Trading | DTN Agriculture | DTN Weather
Follow DTNMarkets on Twitter
DTN.IQ/IQFeed on Twitter
DTN News and Analysis on Twitter
»Forums Index »Archive (2017 and earlier) »IQFeed Developer Support »Market snapshot error on EDS / 5MS command
Author Topic: Market snapshot error on EDS / 5MS command (11 messages, Page 1 of 1)

Larry jag
-Interested User-
Posts: 31
Joined: Dec 28, 2015


Posted: Sep 19, 2019 09:31 PM          Msg. 1 of 11
I am testing out this command:

EDS,2,14,20190919,EDS_TODAY

And recieve this from the server (at 20:27 EDT)

EDS_TODAY,E,Incomplete file from server. 534364/23476219,
EDS_TODAY,!ENDMSG!,
EDS_TODAY,!ENDMSG!,

Not sure why the file is incomplete so late at night. Also, i am seeing TWO !endmsg!

I see the same error with the 5MS command at the same time period:

5MS,2,14,5MS_10_2_14_20190919
5MS_10_2_14_20190919,E,Incomplete file from server. 534364/23391401,
5MS_10_2_14_20190919,!ENDMSG!,
5MS_10_2_14_20190919,!ENDMSG!,

5MS,2,14,5MS_10_2_14_20190919
5MS_10_2_14_20190919,E,Incomplete file from server. 534364/23391401,
5MS_10_2_14_20190919,!ENDMSG!,
5MS_10_2_14_20190919,!ENDMSG!,

DTN_Gary_Stephen
-DTN Guru-
Posts: 394
Joined: Jul 3, 2019


Posted: Sep 20, 2019 10:26 AM          Msg. 2 of 11
Larry,

I will begin looking into this now. I was just able to run that command with no difficulties, so this may be a time-of-day thing.

Sincerely,
Gary Stephen
DTN IQFeed Implementation Support Specialist

Larry jag
-Interested User-
Posts: 31
Joined: Dec 28, 2015


Posted: Sep 20, 2019 02:02 PM          Msg. 3 of 11
Update: I just saw this error in the DAY @ 13:15:46 EDT.

[lastMsg=5MS,2,14,5MS_10_2_14_20190920]

13:15:46.744 [nioEventLoopGroup-2-2] msg=5MS_10_2_14_20190920,E,Incomplete file from server. 534364/23566744,,

Larry jag
-Interested User-
Posts: 31
Joined: Dec 28, 2015


Posted: Sep 23, 2019 11:42 AM          Msg. 4 of 11
Hi Gary. Any updates on this?

Larry jag
-Interested User-
Posts: 31
Joined: Dec 28, 2015


Posted: Sep 30, 2019 09:48 PM          Msg. 5 of 11
Any updates?

DTN_Gary_Stephen
-DTN Guru-
Posts: 394
Joined: Jul 3, 2019


Posted: Oct 1, 2019 04:27 PM          Msg. 6 of 11
Larry,

I haven't been able to reproduce this behavior, and I'm not aware of any other reports of it. What I'd like you to do, if possible, is create a log file. In the Diagnostics app, go to the Logging tab, check Lookup Error in the Lookups section, and Save Changes. If this happens again, go to the same place and click Open Logfile to collect the file. You can send it to me at developer@iqfeed.net for investigation.

Sincerely,
Gary Stephen
DTN IQFeed Implementation Support Specialist

altmany
-Interested User-
Posts: 73
Joined: Jul 30, 2018

IQML - IQFeed-MATLAB connector


Posted: Dec 21, 2019 10:00 AM          Msg. 7 of 11
Another report of this problem: http://forums.dtn.com/index.cfm?page=topic&topicID=5678

I have also gotten an unrelated independent report on this exact same problem for NASDAQ summary data.

It seems to be a problem that multiple people who use multiple different platforms have experienced. Please look into this matter.

Yair Altman
IQML - IQFeed-MATLAB connector
https://UndocumentedMatlab.com/IQML

I am not a DTN employee; my post reflects my personal opinion

John Jones
-Interested User-
Posts: 6
Joined: Dec 20, 2019


Posted: Jan 6, 2020 01:36 PM          Msg. 8 of 11
I logged the error and sent it to developer@iqfeed.net. I am also willing to provide some simple c++ code to demonstrate the issue if necessary. Hopefully this will lead to a diagnosis and solution.

John Jones
-Interested User-
Posts: 6
Joined: Dec 20, 2019


Posted: Jan 6, 2020 04:57 PM          Msg. 9 of 11
This may be a clue: I modified my code to not stop after the NASDAQ Market Summary fails. The application now goes ahead and attempts to download the OPERA Market Summary file. Both resulted in "E,Incomplete file from server. [received]/[expected]. In both cases, the received number was 525628, and the expected number was different.

So perhaps the received number being the same could lead to a cause. Fingers crossed.

DTN_Gary_Stephen
-DTN Guru-
Posts: 394
Joined: Jul 3, 2019


Posted: Jan 7, 2020 02:06 PM          Msg. 10 of 11
All,

We've had a handful of reports of this issue now, and I'm getting an official ticket raised to the development team. My notes about the issue so far:

- This behavior has been very rare. But when it does happen, it can be reproduced.
- So far, only attempts to retrieve the NASDAQ and OPERA exchanges seem to be affected.
- Both 5MS and EDS commands are affected.
- Each time it is reproduced, the number of bits of the failed file is the exactly same (varying slightly by the day it happens and/or exchange). This suggests a corrupt file-type problem as opposed to a connection problem.
- Wine log shows nothing out of the ordinary. All functions appear to work normally until failure point.
- IQFeed log shows an immediate (within 6 seconds) response of 1,E,Incomplete file from server.
- Which means that IQFeed isn't reading through the file, and then reaching a failure point. If so the parts of the file up to the failure point would be in the log.
- Oddly, this Incomplete File From Server message is sent twice, which parallels the report that !END_MSG! appears twice.
- Do not suspect a server issue. In reviewing our logs, affected users connected to a large number of different servers in our load balancing pool.
- I had an affected user (John Jones) see if a basic telnet connection would reproduce the problem. It did. So the issue seems linked to hardware or connection, not the program being run.

If there are any other observations, please add them to this thread. Due to the rarity of the problem, we may not have uncovered everything yet, and any examples will be helpful to have.

Sincerely,
Gary Stephen
DTN IQFeed Implementation Support Specialist

John Jones
-Interested User-
Posts: 6
Joined: Dec 20, 2019


Posted: Jan 7, 2020 03:21 PM          Msg. 11 of 11
In my case, it may be caused by virtualization. I am using Ubuntu 18.04 with a basic installation of wine. I have also tested Windows 10 running in VMWare Workstation 15 Player. Both environments fail with the "Incomplete file from server".

I then attempted the same on a Windows 10 machine (no virtualization) and was not able to reproduce the problem.

Returning to my Ubuntu machine, both "virtual" environments continue to fail. I am happy to help with any other testing you wish me to perform.
 

 

Time: Wed April 17, 2024 11:41 AM CFBB v1.2.0 10 ms.
© AderSoftware 2002-2003