In this paper, we identify and study a novel approach to secure WiMAX network for IKE (Investigation of internet key exchange) in terms of traffic security with the help of gateway security (GSE).Propose work has been applied on Location based network and we have observed the performance analysis of this attack on both type of network possible in WiMAX i.e Packet CS and ATM CS networks. We have done investigation on ASN-GW security with AES, 3 DES and MD5.IPSec is the primary Protocol use in wireless for traffic protection between the communicating entities. It operates on Network Layer and provides protection IP Datagram by encapsulating it into ESP tunnel. In security architecture there are security sublayer for data exchange between the MAC layer and PHY layer. There is no any security Layer has been provided between (ASN and BS) Network Layer/ IP Layer to application layer so this area is still a good for Research for security issues in WiMAX. We have proposed on Gateway security (GSE). In last phase we have given performance comparison between all four conditions with four scenarios. Analysis based on network simulation tool OPNET Modeler 14.5.

1. Md. Rezaul Karim Siddiqui, Sayed Mohammad Atiqur Rahman, “Security analysis of the WiMAX technology in Wireless Mesh networks”, Thesis from Blekinge Institute of Technology (BTH), Karlskrona, Sweden, 2009, pp 42-46
2. ILYAS, S. A, “WiMAX Standards and Security”, 2008. London: CRC Press.
3. Jeffrey G. Andrews, Arunabha Ghosh, Rias Muhammad, “Fundamentals of WiMAX Understanding Broadband Wireless Networking, 2007
4. Seok-Yee Tang, “WiMAX Security and Quality of Service an End-to-End Prospective”, 2010
5. Rakesh jha,Upena D Dalal, “Location Based Performance of WiMAX Network for QoS with Optimal Base Stations (BS)”Wireless engineering and Technology(WET) journal by scientific research, Vol. 2, No.3, PP.135-145, July 2011
6. Rakesh Jha, Upena D Dalal, “Security Analysis of WiMAX Network: With Misbehavior Node Attack” 2011 World Congress on Information and Communication Technologies, WICT-2011, IEEE Xplore, pp-397-404, Dec 2011
7. Rakesh Jha, Upena D Dalal,“ WiMAX System Simulation and Performance Analysis under the Influence of Jamming”, Scientific Journal, Volume -1,No-1,July 2010, pp-20-26

WiMAX Security Analysis IKE GSE Packet CS ATM CS AES MD5 RSA Signature OPNET Modeler IKE GSE Packet CS ATM CS AES MD5 RSA Signature OPNET Modeler