I had a discussion about Sundays on Easter Sunday. I was asked exactly what my guidelines were. My friend knew that I didn't want to work or make other people work or spend money on Sundays, but what else. Why didn't I like going boating? It is a family activity that doesn't put anyone else out and didn't require me to spend any money. I couldn't give an adequate answer. Did we just sit around all day on Sundays growing up? Kind of. Sunday is my sabbath, the Lord has asked that we keep it holy. Our prophets have asked that we actively keep it holy in addition to having it be our day of rest. We are to worship, read, uplift, etc. This is one of the best article's I've found about observing the Sabbath.
President Kimball said, "There is no criticism of legitimate recreation—sports, picnics, plays, and motion pictures. All have potential for revitalizing life, and the Church as an organization actively sponsors such activities. But there is a proper time and place for all worthwhile things—a time for work, a time for play, a time for worship.
Sometimes Sabbath observance is characterized as a matter of sacrifice and self-denial, but it is not so. It is merely a matter of scheduling and choosing seasons. There is time enough, particularly in our era of the world’s history, during the six days of the week in which to do our work and play. Much can be done to organize and encourage weekday activities, avoiding the Sabbath.
...The one hour of devotion did not make of that day a holy day.
...The Sabbath is not a day for indolent lounging about the house or puttering around in the garden, but is a day for consistent attendance at meetings for the worship of the Lord, learning and instruction, enjoying the family, and finding uplift in music and song.
The Sabbath is a holy day in which to do worthy and holy things. Abstinence from work and recreation is important, but insufficient. The Sabbath calls for constructive thoughts and acts, and if one merely lounges about doing nothing on the Sabbath, he is breaking it. To observe it, one will be on his knees in prayer, preparing lessons, studying the gospel, meditating, visiting the ill and distressed, writing letters to missionaries, taking a nap, reading wholesome material, and attending all the meetings of that day at which he is expected.
One good but mistaken man I know claimed he could get more out of a good book on Sunday than he could get in attending church services, saying that the sermons were hardly up to his standards. But we do not go to Sabbath meetings to be entertained or even solely to be instructed. We go to worship the Lord. It is an individual responsibility, and regardless of what is said from the pulpit, if one wishes to worship the Lord in spirit and truth, he may do so by attending his meetings, partaking of the sacrament, and contemplating the beauties of the gospel. If the service is a failure to you, you have failed. No one can worship for you; you must do your own worshiping of the Lord."