At-Taqwa Mosque has two minarets and two green domes. The prayer room can accommodate up to 2,000 people. The mosque was built with a modern and simple architectural concept.  The mosque is a testament of postmodern approach in Malaysian mosque designs, which saw the culmination of contemporary forms and traditional Islamic elements. The mosque has a rectangular hypostyle layout. with the main prayer hall occupying the entire ground floor. The enclosed main prayer hall is now air-conditioned with an overspill area on the side corridor areas and covered inner courtyard. The space allocated for a female prayer gallery and administrative spaces is located on the first floor.

The main building, double volume space, is topped with a high drum pointed-dome covered with green metal sheathing reminiscent of the Al-Masjid Al-Nabawi Mosque in Madinah. Saudi Arabia. Similar but smaller scaled domes are placed near the entrance porch and the annex building near the back lane. Unlike other mosques, the architect employed the use of a pair of minarets which allows for symmetrical architectural image. It is located at the centre of the mosque which separates the main prayer hall and the overspill prayer are. The mosque proper is angled towards the Qibla.

The main prayer hall is identified by a series of pointed arches highlighted with the use of prick framing. The pointed arch is also deployed on the framed doors and side aisle. A similar blind arch is also repeated on the front qibla wall, in the form of calligraphic bands and at the mihrab wall.

The main dome is highly elevated above on the modified squinches: a pair of clerestory windows is placed on each side, thus providing natural lighting. The mihrab area, which was initially a spot for the imam, marked by a smaller niche, has been replaced with a detached timber minbar platform located at the mihrab wall. The mosque has been renovated twice since its completion in 1992.

Apart from the prayer room, it also has a special building as a business centre where there are two floors of a Muslim goods business building. In the same building there is also a café for the congregation to relax after completing the prayers. It also has a special parking space for the congregation.