At present, controversy surrounds two central questions of Cognitive Neurosciences include whether there are sex differences represented in the brain and how the differences in terms of brain anatomy and brain functions associated with one another. Previous efforts to map sex differences among alphabetic language readers and their brain structures have demonstrated that males have larger total brain volume and more gray matter in the temporal and occipital gyri, midbrain, and cerebellum. Alternatively, several studies on the anatomical structure in the cortex have shown that more gray matter is found in several regions of women, mainly responsible for language processing after controlling for the overall brain size, compared with males. Since cognitive strategies vary among different cultures, many researchers suggest that there are different degrees of variation in cognition as well as anatomical structure between Chinese and alphabetic language users. The present study aims to investigate the sex differences in neural structures and functions of the Chinese population and the development of brain cortices among Chinese males and females from childhood to adulthood. Two experiments were conducted to exmaine the sex differences among native Chinese speakers. The first is a functional magnetic resonance imaging (fMRI) study at the semantic level, twenty-two Chinese young adults were recruited. They performed a character decision task with Chinese character pairs which were either semantically ambiguous or precise in meaning. Females performed better in the semantically ambiguous task and activations were found in both right and left hemispheres, thus bi-lateralized brain representations were observed and the neural network performing language tasks among males was distributed leftward in a diffused manner in the brain. The objective of the second study is to find out the volumetric difference of gray matter in the language region in the cortex among normal males and females. This study explored the sex-related differences globally as well as in certian targeted regions by applying a voxel-wise morphometric analysis, voxel-based morphometry (VBM) based the high resolution anatomical images acquired by the Magnetic Resonance Imaging (MRI) technique. The study focused on 2 different age-groups of Chinese speakers, including a group of children from 6 to 11 years, and a group of young adults from 18 to 25 years. The left superior temporal gyrus (BA22) was not only functionally shown to demonstrate variations between males and females, but anatomical differences in the cortex among both sexes also existed. These results suggest the sex difference among children might exist and be universal regardless of races and cultures. Rather, the sex difference among adults may be depending on cultures due to the turning of brain plasticity by the different language acquisition and processing strategies. Evaluation of the brain structure from children to adults in males and females is critical to understand sex differences not only for giving sex-specific teaching methods to normal children, as well as providing another perspective for investigating the prevalence, course and treatment of dyslexia and other language disorders.