A Radio over Fiber (RoF) system has been planned for the advanced performance of radio systems having higher bandwidth for mobile communications. This system combines the optical network with the wireless network for future broadband applications. These systems have numerous advantages compared to the other communication systems. RoF systems have higher bandwidth and immunity to RF interference. Nowadays, broadband communication demand is rising rapidly so, to meet the demand, a large number of base stations (BS) and a large sum of money are required. RoF is a solution since it can operate a lot of BSs that are connected to the central station (CS) by using optical fiber and offer a cost-effective solution. Due to attenuation, dispersion, amplified spontaneous emission noise (ASE), thermal noise, shot noise, and nonlinearities, received signals of RoF tend to be of low quality. Those factors will make the value of bit error rate (BER) high, the value of Q factor low, the received power low, and the receiver will not operate in a high data rate network. In gigabit transmission systems, dispersion, attenuation, ASE, and non-linear effects the communication system and to minimize these problems we have used SCM/WDM-RoF system and cascaded optical amplifiers. The bit error rate must be brought down to a specific level, and the Q factor must be raised. The design of RoF will be simulated by using Opti System software. Based on the calculated BER, Q factor value, and eye diagram height, the RoF receiver’s performance is evaluated. From comparative analysis of EDFA, and Optical Gain+EDFA the performance of the hybrid system is best in terms of Q-factor, BER and received optical power. We have also noticed that ASE noise reduces the performance of RoF system. Key Words: Base Station, Central Office , Control Station,Subcarrier Multiplexing, Radio over Fiber, Radio Frequency