The application of AI in general and Deep learning, in particular, is becoming increasingly popular in human life. AI has been able to replace people in many fields, with data already synthesized and stored by computers that will help AI become smarter. One of the areas where AI can be applied very well is the medical field, especially X-ray imaging. In this study, we propose a convolutional network architecture to classify chest X-ray images as well as apply explanatory methods to trained models to support disease diagnosis. The proposed method provides insight into medical imaging to support the diagnosis of Pneumonia.