Proceedings of International Conference on Applied Innovation in IT
2016/03/10, Volume 1, Issue 4, pp.51-55
High-speed UDP Data Transmission with Multithreading and Automatic Resource Allocation
Dmytro Syzov, Dmitry Kachan, Eduard Siemens
Abstract: In this paper a utilization of the high data-rates channels by threading of sending and receiving is studied. As a communication technology evolves the higher speeds are used more and more in various applications. But generating traffic with Gbps data-rates also brings some complications. Especially if UDP protocol is used and it is necessary to avoid packet fragmentation, for example for high-speed reliable transport protocols based on UDP. For such situation the Ethernet network packet size has to correspond to standard 1500 bytes MTU, which is widely used in the Internet. System may not has enough capacity to send messages with necessary rate in a single-threaded mode. A possible solution is to use more threads. It can be efficient on widespread multicore systems. Also the fact that in real network non-constant data flow can be expected brings another object of study –- an automatic adaptation to the traffic which is changing during runtime. Cases investigated in this paper include adjusting number of threads to a given speed and keeping speed on a given rate when CPU gets heavily loaded by other processes while sending data.
Keywords: high-speed data transport, threading, automatic resource management
- “RFC 894 - A Standard for the Transmission of IP Datagrams over Ethernet Networks.” [Online]. Available: https://tools.ietf.org/html/rfc894. [Accessed: 04-Mar-2016].
- E. He, J. Leigh, O. Yu, and T. A. DeFanti, “Reliable blast UDP: Predictable high performance bulk data transfer,” in Cluster Computing, 2002. Proceedings. 2002 IEEE International Conference on, 2002, pp. 317–324.
- Y. Gu and R. Grossman, “Udtv4: Improvements in performance and usability,” in Networks for Grid Applications, Springer, 2008, pp. 9–23.
- S. Höhlig, “Optimierter Dateitransfer über 100 Gigabit/s,” in 100-Gigabit/s-Workshop in Mannheim, Mannheim, Germany, Sep-2011.
- “Big Data Transmission | F I L A.” [Online]. Available: https://filalab.de/index.php/our-work/big-data-transmission/. [Accessed: 09-Mar-2016].
- D. Kachan, E. Siemens, Comparison of Contemporary Protocols for High-speed Data Transport via 10 Gbps WAN Connections. Proceedings of 2nd International Conference on Applied Innovations in IT. Köthen, pp. 21-27, 2014 (DOI: 10.13142/kt10002.04);
- D. Kachan, E. Siemens, V. Shuvalov, Available bandwidth measurement for 10 Gbps networks. Proceedings in 2015 International Siberian Conference on Control and Communications (SIBCON), 2015, pp. 1–10.
- Linux Programmer's Manual, Linux, p. “socket”.
- S. Srivastava, S. Anmulwar, A. M. Sapkal, T. Batra, A. Gupta, and V. Kumar, “Evaluation of traffic generators over a 40Gbps link,” in Computer Aided System Engineering (APCASE), 2014 Asia-Pacific Conference on, 2014, pp. 43–47.
- V. Vishwanath, T. Shimizu, M. Takizawa, K. Obana, and J. Leigh, “Towards terabit/s systems: Performance evaluation of multi-rail systems,” in High-Speed Networks Workshop, 2007, 2007, pp. 51–55.
- I. Fedotova, E. Siemens, and H. Hu, “A high-precision time handling library,” J. Commun. Comput., vol. 10, pp. 1076–1086, 2013.
- “Apposite Technologies :: Linktropy and Netropy Comparison.” [Online]. Available: http://www.appositetech.com/products/index.html. [Accessed: 04-Mar-2016].
- Linux Programmer's Manual, Linux, p. “stress”.