Machine Learning for Wireless Networking in Highly Dynamic Scenarios
WINDMAL PGC2018- 099959-B-I00 (MCIU/AEI/FEDER,UE)
The interest on using efficiently the Industrial, Scientific and Medical (ISM) spectrum bands for wireless communications is growing also among telecommunications operators offering broadband Internet access. However, due to the free-of-use conditions in ISM bands, and given their current and expected future congestion levels, offering service guarantees to the final users is a very challenging mission due to the complex and highly dynamic interactions between networks competing for the same spectrum resources.
In a network environment of such a complexity, heterogeneity and unpredictability, the current resource management strategies are not capable enough to keep the system working under optimal conditions. In addition, since networks will rarely be in steady state, the use of traditional techniques to analyze the system performance is unfeasible. Under these conditions, there is a growing interest in the use of machine learning techniques, capable of understanding the interactions between competing networks, exploring the effect of different actions, and intelligently choosing those that maximize the overall performance of the system.
Despite some recent interest by the research community and industry, the use of machine learning techniques for resource management in wireless networks is still in its infancy. One of the first questions to solve is where to implement those functionalities to maximize their potential. In the one hand, doing it at the cloud guarantees high computing power and large data availability, thus allowing to take accurate decisions about future network states, but at the cost of a large response delay. In the other hand, moving it to the edge limits both the available data and computational power, but allows to respond fast to a changing environment.
In that crossroad, this project aims to combine efficiently both approaches, i.e., short-term local decisions (based on partial information) with much more accurate but mid/long decisions (based on a global view of the network). This is still and unexplored research path with many challenges in front, including the design of compatible machine learning methods, the definition of the action domains between decision points, and a qualitative and quantitative performance evaluation that takes into account the actions costs and potential overheads, among others aspects.
Solving those challenges is the main goal of this project. We will design and evaluate a network architecture, new functionalities and protocols able to efficiently combine both decentralized and centralized optimization decisions based on the use of machine learning and data analytics. We will also characterize the interactions between local and global decision points (agents), studying both transient and stationary regimes (if exist), stability conditions, and their ability and speed to convergence to optimal solutions.
We expect the project will have a high impact in the research community, standardization committees, and industrial sector, providing both a theoretical and practical framework to test the proposed approach, new functionalities, and machine learning algorithms for key future dense WLAN scenarios. Using our approach we aim to significantly improve the spectrum utilization efficiency of ISM bands, with the goal to achieve a x10 gain with respect to the Quality of Experience observed by final users nowadays.
2022: "The Next Wi-Fi Generation: Towards Intelligent and Multi-Link Enabled Networks" by Alvaro Lopez-Raventos.
2021: "Terahertz Communications: Physical Layer Enablers and Analysis" by Konstantinos Dovelos.
2021: "Responsive Spectrum Management for Wireless Local Area Networks: from Heuristic-based Policies to Model-Free Reinforcement Learning" by Sergio Barrachina-Muñoz.
2020: "Towards Spatial Reuse in Future WLANs: a Sequential Learning Approach" by Francesc Wilhelmi (1st PhD thesis from the WN group).
Francesc Wilhelmi, Jernej Hribar, Selim F Yilmaz, Emre Ozfatura, Kerem Ozfatura, Ozlem Yildiz, Deniz Gündüz, Hao Chen, Xiaoying Ye, Lizhao You, Yulin Shao, Paolo Dini, Boris Bellalta; "Federated Spatial Reuse Optimization in Next-Generation Decentralized IEEE 802.11 WLANs". ITU-T Journal on Emerging Technologies, 2022.
Szymon Szott, Katarzyna Kosek-Szott, Piotr Gawłowicz, Jorge Torres Gómez, Boris Bellalta, Anatolij Zubow, Falko Dressler; "Wi-Fi Meets ML: A Survey on Improving IEEE 802.11 Performance With Machine Learning". IEEE Communications Surveys & Tutorials, 2022.
Marc Carrascosa, Boris Bellalta; "Cloud-gaming: Analysis of google stadia traffic". Computer Communications 188, 99-116, 2022.
Álvaro López-Raventós, Boris Bellalta; "Multi-link Operation in IEEE 802.11be WLANs". IEEE Wireless Communications, 2022.
S Barrachina-Muñoz, A Chiumento, B Bellalta; "Multi-Armed Bandits for Spectrum Allocation in Multi-Agent Channel Bonding WLANs". IEEE Access 9, 133472-133490, 2021.
Francesc Wilhelmi, David Góez, Paola Soto, Ramon Vallés, Mohammad Alfaifi, Abdulrahman Algunayah, Jorge Martin-Pérez, Luigi Girletti, Rajasekar Mohan, K Venkat Ramnan, Boris Bellalta; "Machine Learning for Performance Prediction of Channel Bonding in Next-Generation IEEE 802.11 WLANs". ITU Journal on Future and Evolving Technologies (ITU J-FET), 2021.
S Barrachina-Muñoz, B Bellalta, EW Knightly; "Wi-Fi Channel Bonding: An All-Channel System and Experimental Study From Urban Hotspots to a Sold-Out Stadium". IEEE/ACM Transactions on Networking, 2021.
K Dovelos, M Matthaiou, HQ Ngo, B Bellalta; "Channel Estimation and Hybrid Combining for Wideband Terahertz Massive MIMO Systems". IEEE Journal on Selected Areas in Communications 39 (6), 1604-1620, 2021.
F Wilhelmi, M Carrascosa, C Cano, A Jonsson, V Ram, B Bellalta; "Usage of Network Simulators in Machine-Learning-Assisted 5G/6G Networks". IEEE Wireless Communications 28 (1), 160-166, 2021.
T Adame, M Carrascosa, B Bellalta, I Pretel, I Etxebarria; "Channel load aware AP/Extender selection in Home WiFi networks using IEEE 802.11 k/v". IEEE Access 9, 30095-30112, 2021.
Francesc Wilhelmi Roca, Sergio Barrachina Muñoz, Cristina Cano Bastidas, Ioannis Selinis, Boris Bellalta; "Spatial reuse in IEEE 802.11 ax WLANs". Computer Communications, 2021.
B Bellalta; "On the Low-Latency Region of Best-Effort Links for Delay-Sensitive Streaming Traffic" IEEE Communications Letters, 2021.
Álvaro López Raventós, Boris Bellalta; "Concurrent Decentralized Channel Allocation and Access Point Selection using Multi-Armed Bandits in multi BSS WLANs", Computer Networks, 2020.
F. Wilhelmi, S. Barrachina-Muñoz, B. Bellalta, C. Cano, A. Jonsson, V. Raml.; “A Flexible Machine Learning-Aware Architecture for Future WLANs”. IEEE Wireless Magazine 2020
Marc Carrascosa-Zamacois, Boris Bellalta; "Multi-armed bandits for decentralized AP selection in enterprise WLANs". Computer Communications, 2020.
S. Barrachina, F. Wilhelmi, B. Bellalta; "Online Primary Channel Selection for Dynamic Channel Bonding in High-Density WLANs". IEEE Wireless Communication Letters, 2020.
Conferences / Workshops
D Nunez, F Wilhelmi, S Avallone, M Smith, B Bellalta; "TXOP sharing with Coordinated Spatial Reuse in Multi-AP Cooperative IEEE 802.11 be WLANs" IEEE CCNC 2022.
M Carrascosa, G Geraci, E Knightly, B Bellalta; "An Experimental Study of Latency for IEEE 802.11 be Multi-link Operation". IEEE ICC 2022.
Barrachina-Muñoz, Sergio, Alessandro Chiumento, and Boris Bellalta. "Stateless Reinforcement Learning for Multi-Agent Systems: the Case of Spectrum Allocation in Dynamic Channel Bonding WLANs." Wireless Days 2021, 2021.
López-Raventós, Álvaro, and Boris Bellalta. "IEEE 802.11 be Multi-Link Operation: When the Best Could Be to Use Only a Single Interface." MedComNet, 2021.
S. Barrachina, B. Bellalta, E. Knightly ; "Wi-Fi All-Channel Analyzer". ACM WinTech 2020 (a Mobicom 2020 workshop).
Dovelos, K., Matthaiou, M., Ngo, H. Q., & B. Bellalta; “Massive MIMO with Multi-Antenna Users under Jointly Correlated Ricean Fading”. IEEE International Conference on Communications (ICC), 2020.
Francesc Wilhelmi, Sergio Barrachina, B. Bellalta; "On the Performance of the Spatial Reuse Operation in IEEE 802.11ax WLANs". IEEE Conference on Standards for Communications and Networking (CSCN) 2019.
Francesc Wilhelmi and Sergio Barrachina-Muñoz; "Towards the implementation of 11ax features in Komondor". Workshop on Next-Generation Wireless with NS-3 (WNGW), 2019. [Invited talk]
Alvaro Lopez, Francesc Wilhelmi, Sergio Barrachina, B. Bellalta; "Combining Software Defined Networks and Machine Learning to enable Self Organizing WLANs". Sixth International Workshop on Cooperative Wireless Networks - 2019 (CWN'19) / WIMOB 2019, 2019.
Carrascosa, Marc, and Boris Bellalta. "Decentralized AP selection using Multi-Armed Bandits: Opportunistic ε-Greedy with Stickiness." In 2019 IEEE Symposium on Computers and Communications (ISCC), pp. 1-7. IEEE, 2019.
Talks, Tutorials, Panels
IEEE CCNC 2023: “IEEE 802.11be and Beyond: All You Need to Know about Next-generation Wi-Fi”. With G. Geraci and L. Galati. Jan. 2023.
IEEE Globecom 2022: "IEEE 802.11be and Beyond: All You Need to Know about Next-generation Wi-Fi". With G. Geraci and L. Galati. December 2022.
IEEE 802.11 plenary: “Wi-Fi Meets ML: Re-thinking Next-generation Wi-Fi Networks v2”. With S. Szott. Nov. 2022.
IEEE PIMRC 2022: “IEEE 802.11be and Beyond: All You Need to Know about Next-generation Wi-Fi”. With G. Geraci and L. Galati. Sept. 2022.
IEEE 802.11 AI/ML TIG: “Wi-Fi Meets ML: Re-thinking Next-generation Wi-Fi Networks”. With S. Szott. Sept. 2022. doc.:IEEE 802.11-22/1443r0
Moscow Telecommunication Seminar: WiFi 7: Scheduled Access, Multilink, and TXOP Sharing. Seminar Series organized by IITP RAS, Phystech, and Higher School of Economics. December 2021.
IEEE Globecom 2021: “A Primer on Wi-Fi 7: Objectives, Standardization, and Research”. With G. Geraci and L. Galati. December 2021.
IEEE ICC 2021 Industry Panel. ”IEEE 802.11be: Wi-Fi 7 Strikes Back”. Organized by G. Geraci and L. Galati, with A. Gowans (Ofcom), D. Sundman (Ericsson), and Bin Tian(Qualcomm). June 2021.
IEEE BlackSeeCom 2020. ”What Will Wi-Fi 7 be?”. With G. Geraci and L. Galati. May 2021.
IEEE Globecom 2020. ”Introducing IEEE 802.11be - the Wi-Fi of the future”. With G. Geraci and L. Galati. December 2020.
Simulator for dense Wi-Fi networks (Komondor) [link].
Flow-level simulator for Wi-Fi networks (Neko) [link].
Markovian models SFCTM [link]
Wi-Fi All Channels (WACA) [link]
Google Stadia traces [link]