This study presents the development of a hybrid system consisting of an ensemble of Extended Kalman Filter (EKF) based Multi Layer Perceptron Network (MLPN) and a one-pass learning Fuzzy Inference System using Look-up Table Scheme for the recognition of electrocardiogram (ECG) signals. This system can distinguish various types of abnormal ECG signals such as Ventricular Premature Cycle (VPC), T wave inversion (TINV), ST segment depression (STDP), and Supraventricular Tachycardia (SVT) from normal sinus rhythm (NSR) ECG signal.