Do we have any out of the box option to load the record list view(configured as Grid) only on button click or after loading?

No. But I guess the first question is: why do you want to do this? What are you trying to achieve?

Loading that record list view taking time. inorder to reduce that loading of these records happened only after having some event like button click etc...

Does this imply that there could be a performance issue in how the data is being sourced for the record list in the first place ? i.e. are you looking at the right issue to try to solve ? 

You can reduce the time through various optimisations:

1. Bring back less records - rather than 50, bring back 10
2. Look at where the time is being spent in constructing the list - what is the source of the data? If database, are the tables indexed correctly? Is the database engine data retrieval plan using the latest table statistics? Are you performing processing in Appian (or even doing additional round-trips to the source of the data for each record being loaded) rather than at the data source?

It seems to me that there's already a button click happening before the record list loads - i.e. the click required for the user to open the record list in the first place.

It seems to me that there's already a button click happening before the record list loads - i.e. the click required for the user to open the record list in the first place.