CFP last date
20 May 2024
Reseach Article

SRATE: A Fast and Memory Efficient Request Rate Estimation by State-Rank based Scheme

by Umega Kaul, Suneel Phulere, Vineet Richariya
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 104 - Number 17
Year of Publication: 2014
Authors: Umega Kaul, Suneel Phulere, Vineet Richariya
10.5120/18303-9315

Umega Kaul, Suneel Phulere, Vineet Richariya . SRATE: A Fast and Memory Efficient Request Rate Estimation by State-Rank based Scheme. International Journal of Computer Applications. 104, 17 ( October 2014), 24-31. DOI=10.5120/18303-9315

@article{ 10.5120/18303-9315,
author = { Umega Kaul, Suneel Phulere, Vineet Richariya },
title = { SRATE: A Fast and Memory Efficient Request Rate Estimation by State-Rank based Scheme },
journal = { International Journal of Computer Applications },
issue_date = { October 2014 },
volume = { 104 },
number = { 17 },
month = { October },
year = { 2014 },
issn = { 0975-8887 },
pages = { 24-31 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume104/number17/18303-9315/ },
doi = { 10.5120/18303-9315 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2024-02-06T22:36:26.034298+05:30
%A Umega Kaul
%A Suneel Phulere
%A Vineet Richariya
%T SRATE: A Fast and Memory Efficient Request Rate Estimation by State-Rank based Scheme
%J International Journal of Computer Applications
%@ 0975-8887
%V 104
%N 17
%P 24-31
%D 2014
%I Foundation of Computer Science (FCS), NY, USA
Abstract

In Cloud Computing or Content Distributed Cloud (CDN) workload happens between a local web server and proxy servers. The typical method is DNS redirecting and the workload factoring decision is predefined manually over a set of most popular objects. For such popular object detection in requests tails, many schemes have proposed for fast request rate estimation in traffic monitoring and fast counting for most popular data item for which request arrived and above mentioned jobs done. Accurate request rate estimation is necessary for resource planning & management, measuring compliance to SLAs and cloud security especially in Cloud Computing where we are talking about Integrated, Heterogeneous or Hybrid Cloud deployment model. With following ideals, we propose SRATE (State-Rank bAsed Traffic Estimation) has sufficient short estimation times with provable bounds on estimation error, low memory usage and also easily implementable in hardware for operation at high speeds. With developing such scheme, we achieve up to three orders of magnitude speedup in estimation time. The speedups are achieved with low memory usage by using “State-Rank (0,1,?)” instead of runs or coincidences. This new scheme has many benefits at high oppressive workload including quicker detection of unhandled oppressive data items or spikes with incipient denial of service attacks. As result, we show that the proposed scheme is faster and more accurate than other schemes. We also prove bounds on the scheme’s accuracy, request size or estimation time, average request rate estimation, memory needs, average request sending rate and also show that it performs well by efficient simulation techniques.

References
  1. “Yahoo! Video”. http://video.yahoo.com/.
  2. Duffield, N, Lund, C., and Thorup, M., “Charging from Sampled Network Usage”, SIGCOMM internet Workshop 2001.
  3. Duffield, N, and Grossglauser, M., “Trajectory Sampling for Direct Traffic Observation”, Proceedings of ACM SIGCOMM 2000.
  4. Hao, F., Kodialam, M., and Lakshman, T. V., "ACCEL-RATE: a faster mechanism for memory efficient per-flow traffic estimation", proceedings of ACM SIGMETRICS 2004.
  5. Fang, W, and Peterson, L., “Inter-as Traffic Patterns and their Implications”, Proceedings of IEEE GLOBECOM 1999.
  6. Feldmann, A. et al., “Deriving Traffic Demands for Operational IP Networks: Methodology and Experience”,Proceedings of ACM SIGCOMM’ 2000.
  7. F. Hao, M. S. Kodialam, T. V. Lakshman, and H. Zhang. “Fast, memory-efficient traffic estimation by coincidence counting”. in INFOCOM, 2005, pp. 2080-2090.
  8. Feng, W. et al., “The Blue Queue Management Algorithms”, IEEE/ACM Transactions on Networking, Vol.10, Number 4, 2002.
  9. Aldous, D., “Probability Approximations via the Poisson Clumping Heuristic”, Springer-Verlag, 1987.
  10. Estan, C. , and Varghese, G., "New Directions in Traffic Measurement and Accounting", Proceedings of ACM SIGCOMM 2002.
  11. Kodialam, M., Lakshman, T. V., and Mohanty, S., "Runs bAsed Traffic Estimator (RATE): A simple, Memory Efficient Scheme for Per-Flow Rate Estimation", Pro-ceedings of INFOCOM'2004.
  12. Ferguson, T. S., "A Course in Large Sample Theory",Chapman and Hall, 1996.
  13. Estan, C., Savage, S., and Varghese, G., “Automatically Inferring Patterns of Resource Consumption in Network Traffic", Proceedings of ACM SIGCOMM 2003.
  14. H. Zhang, G. Jiang, K. Yoshihira, H. Chen, and A. Saxena. “Intelligent workload factoring for a hybrid Cloud Computing model”. NEC Labs America Technical Report 2009-L036, Feb 2009.
  15. “Wikipedia- IID”. http://www.wikipedia.com/.
  16. “ComScore Video Metrix report: U.S. Viewers Watched an Average of 3Hours of Online Video in July”. Available: http://www.comscore.com/press/release.asp?press=1678.
  17. Du_eld, N, Lund, C., and Thorup, M., “Charging from Sampled Network Usage", SIGCOMM internet Work-shop 2001.
  18. A. Kumar, M. Sung, J. xu, and J. Wang, “Data streaming algorithms for efficient and accurate estimation of flow distribution”, in Proc. Of ACM SIGMETRICS, June 2004, to appear.
Index Terms

Computer Science
Information Sciences

Keywords

Content Distributed Cloud SRATE Memory Cost