[AGB 08] Agboma F., Liotta A., “QoE-aware QoS management”, Proceedings of the 6th International Conference on Advances in Mobile Computing and Multimedia (MoMM ’08), Linz, Austria, 2008.
[AGR 95] Agrawal R., “Sample mean based index policies with O (log n) regret for the multi-armed bandit problem”, Advances in Applied Probability, vol. 27, no. 4, pp. 1054–1078, 1995.
[AKA 98] Akamai, Akamai, available at http://www.akamai.com, 1998.
[ALM 04] Almeida J., Eager D., Vernon M., et al., “Minimizing delivery cost in scalable streaming content distribution systems”, IEEE Transactions on Multimedia, vol. 6, no. 2, pp. 356–365, 2004.
[AND 02] Andrews M., Shepherd B., Srinivasan A., et al., “Clustering and server selection using passive monitoring”, Proceedings of the 21st IEEE International Conference on Computer Communications (INFOCOM 2002), New York, 2002.
[ANT 08] Antos A., Grover V., Szepesvári C., “Active learning in multi-armed bandits”, 19th International Conference on Algorithmic Learning Theory, Springer, Budapest, Hungary, 2008.
[ARD 01] Ardaiz O., Freitag F., Navarro L., “Improving the service time of web clients using server redirection”, ACM SIGMETRICS Performance Evaluation Review, vol. 29, no. 2, pp. 39–44, 2001.
[ARO 12] Aroussi S., Bouabana-Tebibel T., Mellouk A., “Empirical QoE/QoS correlation model based on multiple parameters for VoD flows”, IEEE GlobeCom 2012, International Conference on Global Communications, Anaheim, California, 2012.
[ATK 07] Atkinson R., Fanto M., RIPv2 cryptographic authentication, Technical report, RFC 4822, 2007.
[AUE 95] Auer P., Cesa-Bianchi N., Freund Y., et al., “Gambling in a rigged casino: the adversarial multi-armed bandit problem”, 36th Annual Symposium on Foundations of Computer Science, IEEE, Milwaukee, WI, 1995.
[AUE 02] Auer P., Cesa-Bianchi N., Fischer P., “Finite-time analysis of the multiarmed bandit problem”, Machine Learning, vol. 47, no. 2, pp. 235–256, 2002.
[AUE 03] Auer P., Cesa-Bianchi N., Freund Y., et al., “The nonstochastic multiarmed bandit problem”, SIAM Journal on Computing, vol. 32, no. 1, pp. 48–77, 2003.
[AUE 09] Auer P., Jaksch T., Ortner R., “Near-optimal regret bounds for reinforcement learning”, Journal of Machine Learning Research, vol. 11, pp. 1563–1600, 2010
[AWE 02] Aweya J., “Transmission control protocol”, Encyclopedia of Telecommunications, Wiley Online Library, John Wiley & Sons, 2002.
[AWE 08] Awerbuch B., Kleinberg R., “Online linear optimization and adaptive routing”, Journal of Computer and System Sciences, vol. 74, no. 1, pp. 97–114, 2008.
[BAR 96] Bartal Y., “Probabilistic approximation of metric spaces and its algorithmic applications”, 37th Annual Symposium on Foundations of Computer Science, IEEE, Burlington, Vermont, pp. 184–193, 1996.
[BAT 10] Batteram H., Damm G., Mukhopadhyay A., et al., “Delivering quality of experience in multimedia networks”, Bell Labs Technical Journal, vol. 15, no. 1, pp. 175–193, 2010.
[BEC 98] Beck M., Moore T., “The Internet2 distributed storage infrastructure project: an architecture for internet content channels”, Computer Networks and ISDN Systems, vol. 30, no. 22–23, pp. 2141–2148, 1998.
[BEL 59] Bellman R., Kalaba R., “On adaptive control processes”, IRE Transactions on Automatic Control, vol. 4, no. 2, pp. 1–9, 1959.
[BER 08] Bernardo F., Vučević N., Umbert A., et al., “Quality of experience evaluation under QoS-aware mobility mechanisms”, Proceedings of the 14th European Wireless Conference, Prague, Czech Republic, September 2008.
[BHA 97] Bhattacharjee S., Ammar M., Zegura E., et al., “Application-layer anycasting”, Proceedings of the 16th Annual Joint Conference of the IEEE Computer and Communications (INFOCOM ’97), Kobe, Japan, 1997.
[BIT 10a] Bitam S., Batouche M., Mellouk A., “QoSBeeManet: a new QoS multipath routing protocol for mobile ad-hoc networks”, GLOBECOM Workshops, IEEE, Miami, Florida, 2010.
[BIT 10b] Bitam S., Batouche M., Talbi E., “A survey on bee colony algorithms”, IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW), IEEE, Atlanta, GA, 2010.
[BOC 10] Bocci M., Bryant S., Frost D., et al., “A framework for MPLS in transport networks”, IETF, RFC5921, ISSN: 2070–1721, 2010.
[BOY 94] Boyan J., Littman M., “Packet routing in dynamically changing networks: a reinforcement learning approach”, Advances in Neural Information Processing Systems, vol. 6, pp. 671–678, 1994.
[BRO 95] Broadband Forum, Broadband Forum, available at http://www.broadband-forum.org/, 1995.
[BRO 10] Brooks P., Hestnes B., “User measures of quality of experience: why being objective and quantitative is important”, IEEE, Network, vol. 24, no. 2, pp. 8–13, 2010.
[BUB 08] Bubeck S., Munos R., Stoltz G., et al., “Online optimization in X-armed bandits”, Neural Information Processing Systems Conference (NIPS), Vancouver, Canada, 2008.
[CES 98] Cesa-Bianchi N., Fischer P., “Finite-time regret bounds for the multiarmed bandit problem”, Proceedings of the 15th International Conference on Machine Learning, MADISON, WI, 1998.
[CHE 06] Chen K., Huang C., Huang P., et al., “Quantifying Skype user satisfaction”, ACM SIGCOMM Computer Communication Review, vol. 36, pp. 399–410, 2006.
[CHE 07] Chen T., “Network traffic modeling”, Handbook of Computer Networks, John Wiley & Sons, pp. 326–339, 2007.
[CHE 10] Chellouche S., Negru D., Borcoci E., et al., “Anycast-based context-aware server selection strategy for VoD services”, GLOBECOM Workshops (GC Wkshps) 2010 IEEE, Miami, Florida, 2010.
[CHI 11] Chikkerur S., Sundaram V., Reisslein M., et al., “Objective video quality assessment methods: a classification, review, and performance comparison”, IEEE Transactions on Broadcasting, vol. 57, no. 2, pp. 165–182, 2011.
[CIU 09] Ciubotaru B., Muntean G., “SAHA-a quality-oriented handover algorithm for multimedia content delivery to mobile users”, IEEE Transactions on Broadcasting, vol. 55, no. 2, pp. 437–450, May 2009.
[COQ 07] Coquelin P., Munos R., “Bandit algorithms for tree search”, Proceedings of the 23rd Conference on Uncertainty in Artificial Intelligence (UAI07), Vancouver, Canada, 2007.
[DEL 99] Delgadillo K., Cisco distributed director, Cisco White Paper, Cisco, 1999.
[DIC 05] Di Caro G., Ducatelle F., Gambardella L., “AntHocNet: an adaptive nature-inspired algorithm for routing in mobile ad hoc networks”, European Transactions on Telecommunications, vol. 16, no. 5, pp. 443–455, 2005.
[DIG 96] Digital Island, Digital Island, available at http://www.digitalisland.com, 1996.
[DIL 02] Dilley J., Maggs B., Parikh J., et al., “Globally distributed content delivery”, IEEE, Internet Computing, vol. 6, no. 5, pp. 50–58, 2002.
[DOR 06] Dorigo M., Birattari M., Stutzle T., “Ant colony optimization”, IEEE, Computational Intelligence Magazine, vol. 1, no. 4, pp. 28–39, 2006.
[DRE 10] Dressler F., Akan O., “Bio-inspired networking: from theory to practice”, Communications Magazine, IEEE, vol. 48, no. 11, pp. 176–183, 2010.
[EDG 06] Edgecast, “EdgeCast Networks”, available at http://www.edgecast.com, 2006.
[ERT 09] Ertel W., Schneider M., Cubek R., et al., “The teaching-box: a universal robot learning framework”, International Conference on Advanced Robotics (ICAR), IEEE, Munich, Germany, 2009.
[ESF 08] Esfahani A., Analoui M., “Widest K-shortest paths Q-routing: a new QoS routing algorithm in telecommunication networks”, International Conference on Computer Science and Software Engineering, IEEE, Wuhan, China, 2008.
[EVE 02] Even-Dar E., Mannor S., Mansour Y., “PAC bounds for multi-armed bandit and Markov decision processes”, Proceedings of the 15th Conference on Computational Learning Theory (COLT02), Sydney, Australia, 2002.
[FIE 10a] Fiedler M., HlavacS H., Hackbarth K., et al., “Quality of Experience”, Annals of Telecommunications, vol. 65, no. 1, pp. 1–2, 2010.
[FIE 10b] Fiedler M., Hossfeld T., Tran-Gia P., “A generic quantitative relationship between quality of experience and quality of service”, IEEE, Network, vol. 24, no. 2, pp. 36–41, 2010.
[GAB 09] Gabillon V., Machine learning tools for online advertisement, Technical report, INRIA, Lille, France, 2009.
[GAD 97] Gadde S., Rabinovich M., Chase J., “Reduce, reuse, recycle: an approach to building large internet caches”, 6th Workshop on Hot Topics in Operating Systems, IEEE Cape Cod, MA, pp. 93–98, 1997.
[GAR 79] Gary M., Johnson D., “Computers and intractability: a guide to the theory of NP-completeness”, A Series of Books in the Mathematical Sciences, W. H. FREEMAN and Co., Victor Klee (ed.), 1979.
[GAR 93] Garcia-LuneS-Aceves J., “Loop-free routing using diffusing computations”, IEEE/ACM Transactions on Networking (TON), vol. 1, no. 1, pp. 130–141, 1993.
[GEL 04] Gelenbe E., Lent R., “Power-aware ad hoc cognitive packet networks”, Ad Hoc Networks, vol. 2, no. 3, pp. 205–216, 2004.
[GEL 06] Gelly S., Wang Y., Munos R., et al., Modification of UCT with patterns in monte-carlo go, Technical report, INRIA, France, 2006.
[GEO 11] Georgii H., Gibbs Measures and Phase Transitions, vol. 9, Walter de Gruyter, 2011.
[GOJ 03] Gojmerac I., Ziegler T., Ricciato F., et al., “Adaptive multipath routing for dynamic traffic engineering”, Global Telecommunications Conference, 2003. GLOBECOM’03. IEEE, San Francisco, CA, 2003.
[GOO 09] Goong Y., Yang F., Huang L., et al., “Model-based approach to measuring quality of experience”, 1st International Conference on Emerging Network Intelligence, Sliema, Malta, 2009.
[GUE 99] Guerin R., Orda A., “QoS routing in networks with inaccurate information: theory and algorithms”, IEEE/ACM Transactions on Networking (TON), vol. 7, no. 3, pp. 350–364, 1999.
[GUO 02] Guo M., Ammar M., Zegura E., “Selecting among replicated batching video-on-demand servers”, Proceedings of the 12th International Workshop on Network and Operating Systems Support for Digital Audio and Video, ACM, Miami, FL, 2002.
[HAM 08] Hamam A., Eid M., El Saddik A., et al., “A quality of experience model for haptic user interfaces”, Proceedings of the 2008 Ambi-Sys Workshop on Haptic User Interfaces in Ambient Media Systems, ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), Quebec, Canada, 2008.
[HAN 09] Han Y., Kim M., Park H., “A novel server selection method to achieve delay-based fairness in the server palm”, IEEE Communications Letters, vol. 13, no. 11, pp. 868870, 2009.
[HAR 92] Hardwick J., Stout Q., Bandit Strategies for Ethical Sequential Allocation, Citeseer, 1992.
[HAS 10] Hassan J., Das S., Hassan M., et al., “Improving quality of experience for network services [Guest Editorial]”, IEEE Network, vol. 24, no. 2, pp. 4–6, 2010.
[HE 08] He J., Rexford J., “Toward internet-wide multipath routing”, IEEE Network, vol. 22, no. 2, pp. 16–21, 2008.
[HEI 08] Heineman G., Pollice G., Selkow S., Algorithms in a Nutshell, O’Reilly Media, 2008.
[HEN 02] Henry P., Luo H., “WiFi: what’s next?”, IEEE Communications Magazine, vol. 40, no. 12, pp. 66–72, 2002.
[HOC 04] Hoceini S., Techniques d’Apprentissage par Renforcement pour le Routage Adaptatif dans les Reseaux de Telecommunication a Trafic irregulier, PhD Thesis, University of Paris-Est Creteil, 2004.
[HOC 08] Hoceini S., Mellouk A., Smail B., “Average-bandwidth delay Q-routing adaptive algorithm”, IEEE International Conference on Communications, ICC’08 IEEE Beijing, China, 2008.
[HUF 02] Huffaker B., Fomenkov M., Plummer D., et al., “k claffy distance metrics in the internet”, IEEE International Telecommunications Symposium, Citeseer, Natal, Brazil, 2002.
[HUY 08] Huynh-Thu Q., Ghanbari M., “Scope of validity of PSNR in image/video quality assessment”, Electronics Letters, vol. 44, no. 13, pp. 800–801, 2008.
[ISO 98] ISO/IEC, “Quality of service: framework”, ISO/IEC 13236, 1998.
[ITU 65] ITU, “International Telecommunication Union”, available at www.itu.int, 1865.
[JAK 10] Jaksch T., Ortner R., Auer P., “Near-optimal regret bounds for reinforcement learning”, The Journal of Machine Learning Research, vol. 11, pp. 1563–1600, 2010.
[JAM 00] Jamin S., Jin C., Jin Y., et al., “On the placement of Internet instrumentation”, Proceedings of the 19th IEEE International Conference on Computer Communications (INFOCOM 2000), Tel Aviv, Israel, 2000.
[JAM 01] Jamin S., Jin C., Kurc A., et al., “Constrained mirror placement on the Internet”, Proceedings of the 20th IEEE International Conference on Computer Communications (INFOCOM 2001), Anchorage, AK, 2001.
[KAA 01] Kaaranen H., Ahtiainen A., Laitinen L., et al., UMTS Networks, Wiley Online Library, 2001.
[KAE 96] Kaelbling L.P., Littman M.L., Moore A.W., “Reinforcement learning: a survey”, Journal of AI Research, vol. 4, pp. 237–285, 1996.
[KAR 99] Karger D., Sherman A., Berkheimer A., et al., “Web caching with consistent hashing”, Computer Networks, vol. 31, no. 11–16, pp. 1203–1213, 1999.
[KAR 05] Kargin V., “On the Chernoff bound for efficiency of quantum hypothesis testing”, The Annals of Statistics, vol. 33, no. 2, pp. 959–976, 2005.
[KEP 03] Kephart J., Chess D., “The vision of autonomic computing”, Computer, vol. 36, no. 1, pp. 41–50, 2003.
[KIL 02] Kilkki K., “Differentiated services for the Internet”, Interpretation, vol. 1, pp. 0099, 2002.
[KIM 08] Kim H.J., Lee D.H., Lee J.M., et al., “The QoE evaluation method through the QoS-QoE correlation model”, 4th International Conference on Networked Computing and Advanced Information Management, Gyeongju, Korea, 2008.
[KIN 93] Kingman J., Poisson Processes, Wiley Online Library, 1993.
[KLE 08] KleinberG R., Slivkins A., Upfal E., “Multi-armed bandits in metric spaces”, Proceedings of the 40th Annual ACM Symposium on Theory of Computing, ACM Victoria, British Columbia, Canada, pp. 681–690, 2008.
[KOC 06] Kocsis L., Szepesvari C., “Bandit based monte-carlo planning”, Machine Learning: ECML 2006, vol. 4212, pp. 282–293, 2006.
[KOH 06] Kohler E., Handley M., Floyd S., “Designing DCCP: congestion control without reliability”, ACM SIGCOMM Computer Communication Review, vol. 36, no. 4, pp. 27–38, 2006.
[KOO 06] Koonen T., “Fiber to the home/fiber to the premises: what, where, and when?”, Proceedings of the IEEE, vol. 94, no. 5, pp. 911–934, 2006.
[KOU 08] Koulouriotis D., Xanthopoulos A., “Reinforcement learning and evolutionary algorithms for non-stationary multi-armed bandit problems”, Applied Mathematics and Computation, vol. 196, no. 2, pp. 913–922, 2008.
[KRI 00] Krishnan P., Raz D., Shavitt Y., “The cache location problem”, IEEE/ACM Transactions on Networking (TON), vol. 8, no. 5, pp. 568–582, 2000.
[KUR 05] Kurose J., Ross K., Computer Networking, Pearson/Addison Wesley, 2005.
[LAI 85] Lai T., Robbins H., “Asymptotically efficient adaptive allocation rules”, Advances in Applied Mathematics, vol. 6, no. 1, pp. 4–22, 1985.
[LEM 10] Lemma E., Hussain S., Anjelo W., Performance comparison of EIGRP/IS-IS and OSPF/IS-IS, Master’s Thesis, Blekinge Tekniska Hogskolan, Sweden, 2010.
[LI 08] Li J., Agent organization in the knowledge plane, PhD Thesis, Cambridge, MA, 2008.
[LIM 01] Limelight, Limelight, available at http://www.limelight.com, 2001.
[LIT 94] Littman M., “Markov games as a framework for multi-agent reinforcement learning”, Proceedings of the 1th International Conference on Machine Learning, New Brunswick, NJ, 1994.
[LOP 11] Lopes Gomes R., Moreira Junior W., Cerqueira E., et al., “Using fuzzy link cost and dynamic choice of link quality metrics to achieve QoS and QoE in wireless mesh networks”, Journal of Network and Computer Applications, vol. 34, no. 2, pp. 506–516, 2011.
[LUC 59] Luce R., Individual Choice Behavior, John Wiley, 1959.
[MA 97] Ma Q., Steenkiste P., “On path selection for traffic with bandwidth guarantees”, Proceedings of the International Conference on Network Protocols, IEEE, Atlanta, GA, 1997.
[MAJ 09] Majd G., Cesar V., Adlen K., “An adaptive mechanism for multipath video streaming over video distribution network (VDN)”, Proceedings of the 1st International Conference on Advances in Multimedia (MMEDIA 2009), Colmar, France, 2009.
[MAN 04] Mannor S., Tsitsiklis J., “The sample complexity of exploration in the multi-armed bandit problem”, The Journal of Machine Learning Research, vol. 5, pp. 623–648, 2004.
[MAO 02] Mao Z., Cranor C., Douglis F., et al., “A precise and efficient evaluation of the proximity between web clients and their local DNS servers”, USENIX Annual Technical Conference, Monterey, Canada, June 2002.
[MAR 91] Maryland Routing Simulator, “Maryland routing simulator”, available at http://www.cs.umd.edu/projects/netcalliper/software.html, 1991.
[MAR 07a] Markaki O., Charilas D., Nikitopoulos D., “Enhancing quality of experience in next generation networks through network selection mechanisms”, 18th International Symposium on Personal, Indoor and Mobile Radio Communications, 2007. PIMRC2007, IEEE Athens, Greece, pp. 1–5, 2007.
[MAR 07b] Marković G., Teodorović D., Aćimović-Raspopović V., “Routing and wavelength assignment in all-optical networks based on the bee colony optimization”, AI Communications, vol. 20, no. 4, pp. 273–285, 2007.
[MAR 10] Martinez-Yelmo I., Seoane I., Guerrero C., “Fair Quality of Experience (QoE) measurements related with networking technologies”, Proceedings of the 8th International Conference on Wired/Wireless Internet Communications, Lulea, Sweden, 2010.
[MEL 94] Mellouk A., Etude des sytèmes modulaires neuro-prédictifs: application à la reconnaissance automatique de la parole continue, PhD Thesis, University Paris-Sud, Orsay, >France, 1994.
[MEL 05] Mellouk A., Hoceini S., “A reinforcement learning approach for QoS based routing packets in integrated service web based systems”, Lecture Notes in Artificial Intelligence, vol. 3528, pp. 299–305, 2005.
[MEL 09] Mellouk A., Hoceini S., Zeadally S., “Design and performance analysis of an inductive QoS routing algorithm”, Computer Communications, Elsevier Ed., vol. 32, pp. 1371–1376, 2009.
[MEL 11a] Mellouk A., Advances in Reinforcement Learning, InTechWeb Education and Publishing Ed., Open Acess, 2011.
[MEL 11b] Mellouk A., Hoceini S., Zeadally S., “A bio-inspired quality of service (QoS) routing algorithm”, IEEE Communications Letters, vol. 15, no. 9, pp. 1016–1018, 2011.
[MEL 13] Mellouk A., Hoceini S., Zeadally S., “A state-dependent time evolving multi-constraint routing algorithm”, ACM Transactions on Autonomous and Adaptive Systems (TAAS), ACM, vol. 8, no. 1, pp. 1–21, 2013.
[MER 09] Mersereau A., Rusmevichientong P., Tsitsiklis J., “A structured multiarmed bandit problem and the greedy policy”, IEEE Transactions on Automatic Control, vol. 54, no. 12, pp. 2787–2802, 2009.
[MIC 79] Michael R., Johnson D., Computers and Intractability: A Guide to the Theory of NP-Completeness, WH Freeman & Co., San Francisco, 1979.
[MOE 08] Moebs S., “A learner, is a learner, is a user, is a customer – QoS-based experience-aware adaptation”, 16th ACM International Conference on Multimedia, Vancouver, Canada, 2008.
[MOY 08] Moy J., OSPF Complete Implementation, Addison-Wesley Professional, 2008.
[NET 89] Network Simulator, “The network simulator”, available at http://www.isi.edu/nsnam/ns/, 1989.
[NLA 06] NLANR, “National laboratory for applied network research”, available at http://www.nlanr.net/, 2006.
[NUA 07] Nuaymi L., WiMAX: Technology for Broadband Wireless Access, Wiley, 2007.
[OKA 09] Okamura H., Dohi T., Trivedi K., “Markovian arrival process parameter estimation with group data”, IEEE/ACM Transactions on Networking (TON), vol. 17, no. 4, pp. 1326–1339, 2009.
[PAN 03] Pan J., Hou Y., Li B., “An overview of DNS-based server selections in content distribution networks”, Computer Networks, vol. 43, no. 6, pp. 695–711, 2003.
[PAT 08] Pathan M., Buyya R., “A taxonomy of CDNs”, Content Delivery Networks, Springer Ed., pp. 33–77, 2008.
[PAT 12] Patel A., Yadav M., “Optimization of routing algorithm using fuzzy neural network”, Asian Journal of Computer Science and Information Technology, vol. 2, no. 7, pp. 180–183, 2012.
[PCM 94] PC Mag, “PC Magazine Digital Edition”, available at http://www.pcmag.com/, 1994.
[PEN 04] Peng G., CDN: Content distribution network, Technical report, Experimental Computer Systems Lab, Department of Computer Science, State University of New York, NY, 2004.
[PIC 97] Picard R., Affective Computing, The MIT Press, Cambridge, MA, vol. 167, p. 170, 1997.
[PIE 06] Pierre G., Van Steen M., “Globule: a collaborative content delivery network”, IEEE Communications Magazine, vol. 44, no. 8, pp. 127–133, 2006.
[QIU 01] Qiu L., Padmanabhan V., Voelker G., “On the placement of web server replicas”, Proceedings of the 20th IEEE International Conference on Computer Communications (INFOCOM 2001), Anchorage, AK, 2001.
[RAD 08] Radlinski F., Kleinberg R., Joachims T., “Learning diverse rankings with multi-armed bandits”, Proceedings of the 25th International Conference on Machine Learning, ACM, New York, NY, 2008.
[RAM 00] Ramalho M., “Intra-and inter-domain multicast routing protocols: a survey and taxonomy”, IEEE Communications Surveys & Tutorials, vol. 3, no. 1, pp. 2–25, 2000.
[REC 94] Recommendation, “ITU E.800: terms and definitions related to quality of service and network performance including dependability”, ITU Telecom, 1994.
[REC 99] Recommendation, “ITU-T P.910: subjective video quality assessment methods for multimedia applications”, ITU Telecom, 1999.
[REC 01a] Recommendation, “ITU-T G.1010: end-user multimedia QoS categories”, ITU Telecom, 2001.
[REC 01b] Recommendation, “ITU-T P.862: perceptual evaluation of speech quality (PESQ): an objective method for end-to-end speech quality assessment of narrow-band telephone networks and speech codecs ”, ITU Telecom, 2001.
[REC 02] Recommendation, “ITU-R BT.500–11: methodology for the subjective assessment of the quality of television pictures”, ITU Telecom, 2002.
[REC 04a] Recommendation, “ITU-R BT.1683: objective perceptual video quality measurement techniques for standard definition digital broadcast television in the presence of a full reference”, ITU Telecom, STANDARD published by International Telecommunications Union, 2004.
[REC 04b] Recommendation, “ITU-T J.144: objective perceptual video quality measurement techniques for digital cable television in the presence of a full reference”, ITU Telecom, 2004.
[REC 05] Recommendation, “ITU-T G.1030: estimating end-to-end performance in IP networks for data applications”, ITU Telecom, 2005.
[REC 06] Recommendation, “ITU P.801: mean opinion score (MOS) terminology”, ITU Telecom, 2006.
[REC 07] Recommendation, “ITU-T G.1070: opinion model for video-telephony applications”, ITU Telecom, 2007.
[REC 08a] Recommendation, “ITU-T J.246: perceptual visual quality measurement techniques for multimedia services over digital cable television networks in the presence of a reduced bandwidth reference”, ITU Telecom, 2008.
[REC 08b] Recommendation, “ITU-T J.247 objective perceptual multimedia video quality measurement in the presence of a full reference”, ITU Telecom, 2008.
[REC 10] Recommendation, “ITU-T J.249: perceptual video quality measurement techniques for digital cable television in the presence of a reduced reference”, ITU Telecom, 2010.
[REC 11a] Recommendation, “ITU-T G.1000 qualité de service des communications: cadre et définitions”, ITU Telecom, 2011.
[REC 11b] Recommendation, “ITU-T G.107: the E-model: a computational model for use in transmission planning”, ITU Telecom, 2011.
[REC 11c] Recommendation, “ITU-T J.342: objective multimedia video quality measurement of HDTV for digital cable television in the presence of a reduced reference signal”, ITU Telecom, 2011.
[RET 09] Rétvári G., Németh F., Chaparadza R., et al., “Ospf for implementing self-adaptive routing in autonomic networks: a case study”, Modelling Autonomic Communications Environments, Springer Berlin Heidelberg, Lecture Notes in Compute Science, vol. 5844, pp. 72–85, 2009.
[RIN 09] Ringserver, “RingServer project”, available at http://www.ring.gr.jp/, 2009.
[RIX 02] Rix A., Hollier M., Hekstra A., et al., “Perceptual evaluation of speech quality (PESQ): the new ITU standard for end-to-end speech quality assessment part I-time-delay compensation”, Journal of the Audio Engineering Society, vol. 50, no. 10, pp. 755–764, 2002.
[ROB 52] Robbins H., “Some aspects of the sequential design of experiments”, Bulletin of the American Mathematical Society, vol. 58, no. 5, pp. 527–535, 1952.
[ROH 00] Rohaly A., Libert J., Corriveau P., et al., “Final report from the video quality experts group on the validation of objective models of video quality assessment”, ITU-T Standards Contribution COM, pp. 9–80, 2000.
[ROU 98] Rousskov A., Wessels D., “Cache digests”, Computer Networks and ISDN Systems, vol. 30, no. 22–23, pp. 2155–2168, 1998.
[RUB 05] Rubino G., “Quantifying the quality of audio and video transmissions over the internet: the PSQA approach”, Design and Operations of Communication Networks: A Review of Wired and Wireless Modeling and Management Challenges, Imperial College Press, London, UK, pp. 233–248, 2005.
[RUS 10] Rusmevichientong P., Tsitsiklis J., “Linearly parameterized bandits”, Mathematics of Operations Research, vol. 35, no. 2, pp. 395–411, 2010.
[SCH 09] Schuler W., Bastos-Filho C., Oliveira A., “A novel hybrid training method for hopfield neural networks applied to routing in communications networks”, International Journal of Hybrid Intelligent Systems, vol. 6, no. 1, pp. 27–39, 2009.
[SCH 10] Schaul T., Bayer J., Wierstra D., et al., “PyBrain”, The Journal of Machine Learning Research, vol. 11, pp. 743–746, 2010.
[SHA 01] Shaikh A., Tewari R., Agrawal M., “On the effectiveness of DNS-based server selection”, Proceedings of the 20th IEEE International Conference on Computer Communications (INFOCOM 2001), Anchorage, AK, 2001.
[SHA 10a] Shaikh J., Fiedler M., Collange D., “Quality of experience from user and network perspectives”, Annals of Telecommunications, vol. 65, no. 1, pp. 47–57, 2010.
[SHA 10b] Sharma M., Kaur H., et al., “Performance evaluation of hybrid network using RIP & IGRP for different applications”, High-Capacity Optical Networks and Enabling Technologies, HONET2010, IEEE, Cairo, Egypt, 2010.
[SOL 06] Soldani D., Li M., Cuny R., QoS and QoE Management in UMTS Cellular Systems, Wiley Online Library, 2006.
[SOU 12] Souihi S., Hoceini S., Mellouk A., et al., “A hierarchical and multi-criteria knowledge dissemination in autonomic networks”, IEEE GlobeCom 2012, International Conference on Global Communications, IEEE, Atlanta, GA, 2012.
[STA 99] Starr T., Cioffi J., Silverman P., Understanding Digital Subscriber Line Technology, Prentice Hall PTR, 1999.
[STE 01] Stewart R., Metz C., “SCTP: new transport protocol for TCP/IP”, IEEE Internet Computing, vol. 5, no. 6, pp. 64–69, 2001.
[SUT 98] Sutton R.S., Barto A.G., Reinforcement Learning: An Introduction, MIT Press, Cambridge, 1998.
[SZY 03] Szymaniak M., Pierre G., Van Steen M., “NetAirt: a flexible redirection system for apache”, International Conference WWW/Internet (ICWI), Algarve, Portugal, 2003.
[TAK 08] Takahashi A., Hands D., Barriac V., “Standardization activities in the ITU for a QoE assessment of IPTV”, IEEE Communications Magazine, vol. 46, no. 2, pp. 78–84, 11/6/20132008.
[TAN 09] Tanner B., White A., “RL-Glue: language-independent software for reinforcement-learning experiments”, The Journal of Machine Learning Research, vol. 10, pp. 2133–2136, 2009.
[TEO 05] Teodorović D., Dell’Orco M., “Bee colony optimization – a cooperative learning approach to complex transportation problems”, Advanced OR and AI Methods in Transportation, Proceedings of 16th Mini–EURO Conference and 10th Meeting of EWGT (13–16 September 2005), Publishing House of the Polish Operational and System Research, Poznan, Poland, 2005.
[TMF 88] TM Forum, available at http://www.tmforum.org/, 1988.
[TRA 10] Tran H.A., Mellouk A., Hoceini S., et al., QoE-based concepts and models for end-to-end network services based on user perception, Technical report, Laboratory LISSI, University Paris-Est Creteil, 2010.
[TRA 13a] Tran H.A., Mellouk A., Hoceini S., et al., “A dynamic QoE routing system for user-centric applications”, Transactions on Emerging Telecommunications Technologies, vol. 24, no. 3, pp. 266–279, 2013.
[TRA 13b] Tran H.A., Mellouk A., Perez J., et al., “QoE-based server selection for content distribution networks”, IEEE Transactions on Computers, DOI:http://doi.ieeecomputersociety.org/10.1109/TC.2013.33, to appear, 2013.
[TRI 10] Trinh T., Sonkoly B., Molnár S., “On the fairness characteristics of Fast TCP”, Annals of Telecommunications, vol. 65, no. 1, pp. 73–85, 2010.
[VAL 98] Vallopillil V., Ross K., “Internet draft: cache array routing protocol v1. 0”, available at http://icp.ircache.net/carp.txt, 1998.
[VER 05] Vermorel J., Mohri M., “Multi-armed bandit algorithms and empirical evaluation”, Proceedings of the 16th European Conference on Machine Learning (ECML 2005), Porto, Portugal, 2005.
[VLE 08] Vleeschauwer B.D., Turck F.D., Dhoedt B., et al., “End-to-end QoE optimization through overlay network deployment”, International Conference on Information Networking, Busan, Korea, 2008.
[WAN 95] Wang Z., Crowcroft J., “Bandwidth-delay based routing algorithms”, Global Telecommunications Conference, GLOBECOM’95, IEEE, Singapore, 1995.
[WAN 96] Wang Z., Crowcroft J., “Quality-of-service routing for supporting multimedia applications”, IEEE Journal on Selected Areas in Communications, vol. 14, no. 7, pp. 12281234, 1996.
[WAN 04] Wang Z., Bovik A., Sheikh H., et al., “Image quality assessment: from error visibility to structural similarity”, IEEE Transactions on Image Processing, vol. 13, no. 4, pp. 600–612, 2004.
[WAN 08] Wang Y., Munos R., Audibert J., “Algorithms for infinitely many-armed bandits”, Proceeding of Advances in Neural Information Processing Systems, Vancouver, Canada, 2008.
[WAT 89] Watkins H., Learning from delayed rewards, PhD Thesis, Cambridge University, 1989.
[WAT 92a] Watkins, Daylan, “Technical note: Q-learning”, Machine Learning, vol. 8, no. 3, pp. 279–292, 1992.
[WAT 92b] Watkins C., Dayan P., “Q-learning”, Machine Learning, vol. 8, no. 3, pp. 279292, 1992.
[WAX 93] Waxman B., “Performance evaluation of multipoint routing algorithms”, Proceedings of the 12th IEEE International Conference on Computer Communications (NFOCOM 93), San Francisco, CA, 1993.
[WEL 06] Welch J., Clark J., “RFC4445 – a proposed media delivery index (MDI)”, IETF, RFC4445, 2006.
[WEN 10] Wendell P., Jiang J., Freedman M., et al., “Donar: decentralized server selection for cloud services”, ACM SIGCOMM Computer Communication Review, ACM, vol. 40, pp. 231–242, 2010.
[WES 97] Wessels D., Claffy K., Application of internet cache protocol (ICP), version 2, 1997.
[WIJ 10] Wijnants M., Lamotte W., De Vleeschauwer B., et al., “Optimizing user quality of experience through overlay routing, bandwith management and dynamic transcoding”, International Journal of Adaptive, Resilient and Automatic Systems, vol. 1, no. 2, p. 64, 2010.
[WIK 01] Wikipedia, “Wikipedia, the free encyclopedia”, available at http://wikipedia.org, 2001.
[YAM 07] Yamada H., Fukumoto N., Isomura M., et al., “A QoE based service control scheme for RACF in IP-based FMC networks”, E- Commerce Technology and the 4th IEEE International Conference on Enterprise Computing, Tokyo, Japan, 2007.
[YIN 10] Yin H., Liu X., Min G., et al., “Content delivery networks: a bridge between emerging applications and future IP networks”, IEEE Network, vol. 24, no. 4, pp. 52–56, 2010.
[YOS 97] Yoshikawa C., Chun B., Eastham P., et al., “Using smart clients to build scalable services”, Proceedings of the 1997 USENIX Technical Conference, Anaheim, California, 1997.
[ZHA 07] Zhang J., Hu H., Wang T., et al., “QOSPF-improved routing algorithm with bandwidth and delay metrics”, Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunication, vol. 30, no. 4, pp. 134–138, 2007.
[ZHA 11] Zhang J., Ansari N., “On assuring end-to-end QoE in next generation networks: challenges and a possible solution”, IEEE Communications Magazine, vol. 49, no. 7, pp. 185–191, 2011.
[ZHO 08] Zhou X., Dreibholz T., Rathgeb E., “A new server selection strategy for reliable server pooling in widely distributed environments”, 2nd International Conference on the Digital Society, IEEE Sainte Luce, Martinique, 2008.