Issues with both Servers & Clients Downloading mods
Rothgar
Join Date: 2009-11-13 Member: 69372Members
Well I figured I'd post this here in the hopes that UWE will look into this and fix it.
I will say right now I do not run any proxy server on my network.
I have mentioned issues with the Server.exe downloading mods numerous times in a few threads:
<a href="http://www.unknownworlds.com/ns2/forums/index.php?showtopic=124547" target="_blank">http://www.unknownworlds.com/ns2/forums/in...howtopic=124547</a>
<a href="http://www.unknownworlds.com/ns2/forums/index.php?showtopic=125516" target="_blank">http://www.unknownworlds.com/ns2/forums/in...howtopic=125516</a>
I also made a GetSatisfaction post here:
<a href="https://getsatisfaction.com/unknownworlds/topics/downloading_larger_mods_from_server_exe_fails_with_error_28" target="_blank">https://getsatisfaction.com/unknownworlds/t...s_with_error_28</a>
I know there must be a problem with the way that the Server.exe is downloading, whether it be a download function timeout feature or something, it almost seems like the download ends prematurely? I have for instance got a TCP dump view through Wireshark of the Server.exe downloading a mod to see the packets and they just end (prematurely from what I can see).
The error you get in Server console is:
<!--c1--><div class='codetop'>CODE</div><div class='codemain'><!--ec1-->Error: Error installing mod 'NS2c' (download failed: 28)<!--c2--></div><!--ec2-->
Using the Wireshark information I was able to get the HTTP URL that the Server.exe queries on the Steam Workshop and in a Web browser I can download the file from the Steam Workshop 100% OK. My internet download speeds are about 1.2MB/s and I get that through my Web browser when downloading the file from the Steam Workshop (In layman terms it downloads very quickly through the browser so speed should not be a problem).
I can also extract the manually downloaded file into the correct mod folder and on the next load the Server.exe queries the Steam Workshop, but since I have the right version of the mod it successfully loads (since there is no further downloading required).
Now I thought (Because my client, that is running on the same network as the server in question, was able to download the mod automatically when joining the server having the download issue) that it must just be a Server.exe problem. This does not look to be the case.
Please keep in mind, my Server is on the same network as my PC and I even tried running the Server.exe from my Client PC to see whether there was a slight chance it was some sort of network/proxy issue on my server, but it clearly isn't it failed with the exact same message in the Server console.
Now when others connect to my server, it's hit and miss if people download the mod successfully. Since I do not have full access over their PC I can't get much in depth information or testing done, however I gave one of the people having the issue the Steam Workshop download link and again they were able to download the file fine. Keeping in mind that their download speeds were much slower? I again do not know if there is a timeout feature for the downloading function on the clients either? The mod I am referencing having the issues on a larger scale is NS2C (Natural Selection 2 Classic) which is about 20MB of content on the Steam Workshop and I would say easily the largest NS2 mod currently on the Steam Workshop.
From the Server.exe side it doesn't show much information but here is a small paste of the person I was testing with connecting (Might be nice to have time stamping in the future for the Server.exe as well?):
<!--c1--><div class='codetop'>CODE</div><div class='codemain'><!--ec1-->Client connecting (X.X.X.X)
Client disconnected (X.X.X.X) Quit
Client connecting (X.X.X.X)
Client disconnected (X.X.X.X) Quit
Client connecting (X.X.X.X)
Client connecting (X.X.X.X)
Client disconnected (X.X.X.X) Quit
Client connecting (X.X.X.X)
Client connecting (X.X.X.X)
Client disconnected (X.X.X.X) Quit
Client disconnected (X.X.X.X) Timeout
Client connecting (X.X.X.X)
Client disconnected (X.X.X.X) Timeout
Client connecting (X.X.X.X)
Client disconnected (X.X.X.X) Quit
Client connecting (X.X.X.X)
Client connecting (X.X.X.X)
Client disconnected (X.X.X.X) Authentication failed
Client connecting (X.X.X.X)
Client disconnected (X.X.X.X) Authentication failed
Client disconnected (X.X.X.X) Timeout
Client connected (X.X.X.X)<!--c2--></div><!--ec2-->
I don't believe the Timeout messages in the above are related, I think that was when we restarted the router just to see if that would help. From the clients perspective from what I understand, it just sits at downloading mods.
I posted previously a GetSatisfaction about clients failing to connect to a modded server here:
<a href="https://getsatisfaction.com/unknownworlds/topics/client_connection_timeouts_if_downloading_a_number_of_mods" target="_blank">https://getsatisfaction.com/unknownworlds/t..._number_of_mods</a>
Also I might suggest adding more information on the downloading of mods which is posted here:
<a href="https://getsatisfaction.com/unknownworlds/topics/provide_more_status_details_when_clients_are_downloading_mods" target="_blank">https://getsatisfaction.com/unknownworlds/t...ownloading_mods</a>
Enough clients are failing to join that I would suggest UWE look into the problem and as I put as a suggestion adding more information to the "downloading mods" might assist with seeing where it gets to in the download process?
Also something I thought about yesterday and I have no idea if this affects any of the NS2 Services at all but when the NS2 Web Servers are down for maintenance i.e. Backups does this cause any of the Mod downloading, Server Browser features or similar to stop working? i.e. do any of the NS2 client or server features try to query the NS2 Web Servers which struggle to respond during backup times? if so this might be something you want to look at fixing?
I will say right now I do not run any proxy server on my network.
I have mentioned issues with the Server.exe downloading mods numerous times in a few threads:
<a href="http://www.unknownworlds.com/ns2/forums/index.php?showtopic=124547" target="_blank">http://www.unknownworlds.com/ns2/forums/in...howtopic=124547</a>
<a href="http://www.unknownworlds.com/ns2/forums/index.php?showtopic=125516" target="_blank">http://www.unknownworlds.com/ns2/forums/in...howtopic=125516</a>
I also made a GetSatisfaction post here:
<a href="https://getsatisfaction.com/unknownworlds/topics/downloading_larger_mods_from_server_exe_fails_with_error_28" target="_blank">https://getsatisfaction.com/unknownworlds/t...s_with_error_28</a>
I know there must be a problem with the way that the Server.exe is downloading, whether it be a download function timeout feature or something, it almost seems like the download ends prematurely? I have for instance got a TCP dump view through Wireshark of the Server.exe downloading a mod to see the packets and they just end (prematurely from what I can see).
The error you get in Server console is:
<!--c1--><div class='codetop'>CODE</div><div class='codemain'><!--ec1-->Error: Error installing mod 'NS2c' (download failed: 28)<!--c2--></div><!--ec2-->
Using the Wireshark information I was able to get the HTTP URL that the Server.exe queries on the Steam Workshop and in a Web browser I can download the file from the Steam Workshop 100% OK. My internet download speeds are about 1.2MB/s and I get that through my Web browser when downloading the file from the Steam Workshop (In layman terms it downloads very quickly through the browser so speed should not be a problem).
I can also extract the manually downloaded file into the correct mod folder and on the next load the Server.exe queries the Steam Workshop, but since I have the right version of the mod it successfully loads (since there is no further downloading required).
Now I thought (Because my client, that is running on the same network as the server in question, was able to download the mod automatically when joining the server having the download issue) that it must just be a Server.exe problem. This does not look to be the case.
Please keep in mind, my Server is on the same network as my PC and I even tried running the Server.exe from my Client PC to see whether there was a slight chance it was some sort of network/proxy issue on my server, but it clearly isn't it failed with the exact same message in the Server console.
Now when others connect to my server, it's hit and miss if people download the mod successfully. Since I do not have full access over their PC I can't get much in depth information or testing done, however I gave one of the people having the issue the Steam Workshop download link and again they were able to download the file fine. Keeping in mind that their download speeds were much slower? I again do not know if there is a timeout feature for the downloading function on the clients either? The mod I am referencing having the issues on a larger scale is NS2C (Natural Selection 2 Classic) which is about 20MB of content on the Steam Workshop and I would say easily the largest NS2 mod currently on the Steam Workshop.
From the Server.exe side it doesn't show much information but here is a small paste of the person I was testing with connecting (Might be nice to have time stamping in the future for the Server.exe as well?):
<!--c1--><div class='codetop'>CODE</div><div class='codemain'><!--ec1-->Client connecting (X.X.X.X)
Client disconnected (X.X.X.X) Quit
Client connecting (X.X.X.X)
Client disconnected (X.X.X.X) Quit
Client connecting (X.X.X.X)
Client connecting (X.X.X.X)
Client disconnected (X.X.X.X) Quit
Client connecting (X.X.X.X)
Client connecting (X.X.X.X)
Client disconnected (X.X.X.X) Quit
Client disconnected (X.X.X.X) Timeout
Client connecting (X.X.X.X)
Client disconnected (X.X.X.X) Timeout
Client connecting (X.X.X.X)
Client disconnected (X.X.X.X) Quit
Client connecting (X.X.X.X)
Client connecting (X.X.X.X)
Client disconnected (X.X.X.X) Authentication failed
Client connecting (X.X.X.X)
Client disconnected (X.X.X.X) Authentication failed
Client disconnected (X.X.X.X) Timeout
Client connected (X.X.X.X)<!--c2--></div><!--ec2-->
I don't believe the Timeout messages in the above are related, I think that was when we restarted the router just to see if that would help. From the clients perspective from what I understand, it just sits at downloading mods.
I posted previously a GetSatisfaction about clients failing to connect to a modded server here:
<a href="https://getsatisfaction.com/unknownworlds/topics/client_connection_timeouts_if_downloading_a_number_of_mods" target="_blank">https://getsatisfaction.com/unknownworlds/t..._number_of_mods</a>
Also I might suggest adding more information on the downloading of mods which is posted here:
<a href="https://getsatisfaction.com/unknownworlds/topics/provide_more_status_details_when_clients_are_downloading_mods" target="_blank">https://getsatisfaction.com/unknownworlds/t...ownloading_mods</a>
Enough clients are failing to join that I would suggest UWE look into the problem and as I put as a suggestion adding more information to the "downloading mods" might assist with seeing where it gets to in the download process?
Also something I thought about yesterday and I have no idea if this affects any of the NS2 Services at all but when the NS2 Web Servers are down for maintenance i.e. Backups does this cause any of the Mod downloading, Server Browser features or similar to stop working? i.e. do any of the NS2 client or server features try to query the NS2 Web Servers which struggle to respond during backup times? if so this might be something you want to look at fixing?
Comments
Here are various screenshots of download status through Wireshark which is a Packet Inspection Tool.
First a successful conversation (Co_Down):
You can actually see it mention co_down in part of the data being downloaded and notice the "Entire Coversation" Size at the bottom is greater than the "Content-Length" (size in bytes of the download)
<img src="http://www.dawgclan.net/images/ns2/NS2%20Wireshark%20Success.jpg" border="0" class="linked-image" />
Now the failures (2 different examples ns2_co_stargate and Combat Mode). I ran the Server.exe twice to make sure that it wasn't stopping at a certain size etc. Obviously results are slightly different due to downloads speeds not being consistent:
<img src="http://www.dawgclan.net/images/ns2/NS2%20Wireshark.jpg" border="0" class="linked-image" />
<img src="http://www.dawgclan.net/images/ns2/NS2%20Wireshark%202.jpg" border="0" class="linked-image" />
<img src="http://www.dawgclan.net/images/ns2/NS2%20Wireshark%203.jpg" border="0" class="linked-image" />
<img src="http://www.dawgclan.net/images/ns2/NS2%20Wireshark%204.jpg" border="0" class="linked-image" />
NOTE: I am not a Network Expert, My information could be entirely wrong but I know enough to believe the information I stated above is correct and there is a download timeout issue somewhere in the NS2 Code...
<img src="http://www.dawgclan.net/images/ns2/NS2%20Wireshark%205.jpg" border="0" class="linked-image" />
<img src="http://www.dawgclan.net/images/ns2/NS2%20Wireshark%206.jpg" border="0" class="linked-image" />
From all these captures it seems I get to about 5.5MB worth of data and then it times out kills the connection and then you get the error 28.
I have downloaded from the Steam Cloud manually and get around 1.2MB/s (Megabytes). In the above examples the NS2C ones are single mod only, while the original examples were not downloading as much of the individual mods as it is downloading both at the same time.
I'll post some examples of putting Combat Mode back in place and just trying to download ns2_co_stargate in the next post.
<img src="http://www.dawgclan.net/images/ns2/NS2%20Wireshark%208.jpg" border="0" class="linked-image" />
I hope I can get someone from UWE to acknowledge they would look into this, I don't know how much more testing I have left in me :(
<a href="http://cloud-2.steampowered.com/ugc/541820196272585660/20A79419FAABA4FFD09F72A978533BBAAE0DE5D9/" target="_blank">http://cloud-2.steampowered.com/ugc/541820...533BBAAE0DE5D9/</a>
Into my Web Browser and manually downloading the file...
As you can see the conversation is complete 100% and again "Entire Conversation" is larger than the "Content-Length"
<img src="http://www.dawgclan.net/images/ns2/NS2%20Wireshark%20Manual.jpg" border="0" class="linked-image" />
Console Log:
Connecting to server 130.194.4.241:27021
Downloading mods
Starting download of 'Combat Mode'
Starting download of 'Ns2 co_faceoff remake'
Starting download of 'co_chuteout'
Error: Couldn't download mod 'Ns2 co_faceoff remake' (error code: 16)
Error: Couldn't mount 'C:/Users/username/AppData/Roaming/Natural Selection 2/Workshop/m5f35045_1354654579'
Error: Couldn't mount 'C:/Users/username/AppData/Roaming/Natural Selection 2/Workshop/m55e90a3_1354863173'
Error: File 'game_setup.xml' failed consistency check!
Error: Couldn't mount 'C:/Users/username/AppData/Roaming/Natural Selection 2/Workshop/m55e90a3_1354863173'
Loading config://ConsoleBindings.json
Loading config://FavoriteServers.json
Main Menu Initialized at Version: 232
Steam Id: 20390
Error: Couldn't download mod 'co_chuteout' (error code: 16)
Error: Couldn't download mod 'Combat Mode' (error code: 16)
Error: File 'game_setup.xml' failed consistency check!
Error: File 'lua/UpgradableMixin.lua' failed consistency check!
Error: File 'ui/menu/logo.dds' failed consistency check!
Error: File 'lua/UpgradableMixin.lua' failed consistency check!
Error: File 'lua/UpgradableMixin.lua' failed consistency check!
Error: File 'lua/UpgradableMixin.lua' failed consistency check!
Error: File 'lua/UpgradableMixin.lua' failed consistency check!
Error: File 'lua/UpgradableMixin.lua' failed consistency check!
Error: File 'lua/UpgradableMixin.lua' failed consistency check!
Loading config://ConsoleBindings.json
Loading config://FavoriteServers.json
Error: Client class hierarchy for mac does not match server class
Connecting to server 130.194.4.241:27021
Downloading mods
Starting download of 'Combat Mode'
Starting download of 'co_chuteout'
Mod 'co_chuteout' installed
Mod 'Combat Mode' installed
Finished downloading and installing mods
Mounting mod from C:/Users/username/AppData/Roaming/Natural Selection 2/Workshop/m5f35045_1354654579
Mounting mod from C:/Users/username/AppData/Roaming/Natural Selection 2/Workshop/m55e90a3_1354863173
Loading config://ConsoleBindings.json
Loading config://FavoriteServers.json
Loading 'maps/ns2_chuteout.level'
<!--c1--><div class='codetop'>CODE</div><div class='codemain'><!--ec1-->Date: 12/08/12
Time: 17:18:09
--------------------------------------------------------------
Build 232
Steam initialized
Render Device: NVIDIA GeForce GTX 590 (9.18.13.623)
Sound Device: Speakers (Logitech G35 Headset) 7.1
Record Device: Microphone (Logitech G35 Headset)
Loading config://ConsoleBindings.json
Loading config://FavoriteServers.json
Main Menu Initialized at Version: 232
Steam Id: 20390
Connecting to server 192.168.50.1:27015
Downloading mods
Starting download of 'Combat Mode'
Starting download of 'co_chuteout'
Starting download of 'Ns2 co_faceoff remake'
Starting download of 'Co_Summit'
Starting download of 'ns2 co_pulse remake'
Starting download of 'co_Core remake (Alpha 3)'
Starting download of 'ns2_co_stargate'
Starting download of 'Co_Down'
Mod 'Combat Mode' installed
Mod 'ns2_co_stargate' installed
Starting download of 'ns2_co_veilcombat'
Starting download of 'Co_Ulysses'
Starting download of 'CO_ROCKDOWN'
Starting download of 'co_docking_station'
Starting download of 'co_assault'
Starting download of 'NS2c'
Mod 'Co_Ulysses' installed
Mod 'NS2c' installed
Mod 'Ns2 co_faceoff remake' installed
Mod 'ns2 co_pulse remake' installed
Mod 'Co_Down' installed
Mod 'co_chuteout' installed
Mod 'co_assault' installed
Error: Couldn't download mod 'ns2_co_veilcombat' (error code: 16)
Error: Couldn't download mod 'CO_ROCKDOWN' (error code: 16)
Error: Couldn't download mod 'co_docking_station' (error code: 16)
Loading config://ConsoleBindings.json
Loading config://FavoriteServers.json
Main Menu Initialized at Version: 232
Steam Id: 20390
Mod 'Co_Summit' installed
Mod 'co_Core remake (Alpha 3)' installed
Connecting to server 192.168.50.1:27015
Downloading mods
Starting download of 'ns2_co_veilcombat'
Starting download of 'CO_ROCKDOWN'
Starting download of 'co_docking_station'
Mod 'CO_ROCKDOWN' installed
Mod 'co_docking_station' installed
Mod 'ns2_co_veilcombat' installed
Finished downloading and installing mods
Mounting mod from C:/Users/username/AppData/Roaming/Natural Selection 2/Workshop/m5f35045_1354654579
Mounting mod from C:/Users/username/AppData/Roaming/Natural Selection 2/Workshop/m55e90a3_1354863173
Mounting mod from C:/Users/username/AppData/Roaming/Natural Selection 2/Workshop/m4d41f11_1354741645
Mounting mod from C:/Users/username/AppData/Roaming/Natural Selection 2/Workshop/m4fd7fd4_1342767525
Mounting mod from C:/Users/username/AppData/Roaming/Natural Selection 2/Workshop/m57c685f_1351989386
Mounting mod from C:/Users/username/AppData/Roaming/Natural Selection 2/Workshop/m57f5f9a_1352901101
Mounting mod from C:/Users/username/AppData/Roaming/Natural Selection 2/Workshop/m6523544_1354819743
Mounting mod from C:/Users/username/AppData/Roaming/Natural Selection 2/Workshop/m5faeac4_1349135772
Mounting mod from C:/Users/username/AppData/Roaming/Natural Selection 2/Workshop/m662442f_1353075763
Mounting mod from C:/Users/username/AppData/Roaming/Natural Selection 2/Workshop/m672f332_1354486953
Mounting mod from C:/Users/username/AppData/Roaming/Natural Selection 2/Workshop/m62b22b1_1350645013
Mounting mod from C:/Users/username/AppData/Roaming/Natural Selection 2/Workshop/m6991825_1354187934
Mounting mod from C:/Users/username/AppData/Roaming/Natural Selection 2/Workshop/m54da949_1344863485
Mounting mod from C:/Users/username/AppData/Roaming/Natural Selection 2/Workshop/m5f7771c_1354470501
Loading config://ConsoleBindings.json
Loading config://FavoriteServers.json
Loading 'maps/ns2_chuteout.level'
Building pathing mesh for level maps/ns2_chuteout.level
OK! Loaded tile cache grid from maps/ns2_chuteout.level-client.tile_cache_grid
Client : 0.000000 : TIME ..0.000000s InitPathing
Client : 0.000000 : TIME ..0.000000s Scoreboard_Clear
Client : 0.000000 : TIME ..0.000000s CheckRules
Finished loading 'maps/ns2_chuteout.level'<!--c2--></div><!--ec2-->