Correct.
Baptism by the Holy Spirit is experienced by all who believe on Jesus Christ as their Savior at the moment of salvation, and it is not to be repeated (
Romans 8:9). In that baptism believers are identified with Christ as the Head of the Body, and are indwelt by the Spirit (
John 4:14; 7:38-39).
The baptism by the Spirit occurs at conversion when the Holy Spirit enters the believing sinner and gives him new life, and makes his body the temple of the Spirit
(1 Corinthians 6:19-20). All believers have experienced this once-for-all baptism at the moment of salvation (
Romans 8:9).
The presence of the Holy Spirit and His availability for all believers is the norm in the New Testament.