Is baptism the only way of celebrating the arrival of a new child? 

There is also available a service of Thanksgiving for the Birth of a Child. This ceremony blesses and names the child, presents it with a Bible and gives adults in the family a chance to promise to care for the new child. Parents might choose this service for a number of reasons: if they wish the child to make its own decision about baptism when older; if one parent follows another faith; if the family is not ready to identify as Christian in the way that baptism implies. Speak to the clergy if you are interested in organising a Thanksgiving.