FIT Profiler Report

------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  Action                                                                                                                                                                                                     	|  Mean duration (s)	|  Num calls      	|  Total time (s) 	|  Percentage %   	|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  Total                                                                                                                                                                                                      	|  -              	|  881585         	|  2707.5         	|  100 %          	|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  run_training_epoch                                                                                                                                                                                         	|  132.43         	|  20             	|  2648.7         	|  97.828         	|
|  run_training_batch                                                                                                                                                                                         	|  0.12577        	|  20000          	|  2515.5         	|  92.907         	|
|  [LightningModule]NeRFSystem.optimizer_step                                                                                                                                                                 	|  0.12542        	|  20000          	|  2508.4         	|  92.645         	|
|  [Strategy]SingleDeviceStrategy.training_step                                                                                                                                                               	|  0.038616       	|  20000          	|  772.33         	|  28.525         	|
|  [Strategy]SingleDeviceStrategy.backward                                                                                                                                                                    	|  0.0046947      	|  20000          	|  93.895         	|  3.4679         	|
|  [TrainingEpochLoop].train_dataloader_next                                                                                                                                                                  	|  0.0037927      	|  20000          	|  75.853         	|  2.8016         	|
|  [LightningModule]NeRFSystem.setup                                                                                                                                                                          	|  45.649         	|  1              	|  45.649         	|  1.686          	|
|  [Strategy]SingleDeviceStrategy.validation_step                                                                                                                                                             	|  0.46497        	|  70             	|  32.548         	|  1.2021         	|
|  [Callback]TQDMProgressBar.on_train_batch_end                                                                                                                                                               	|  0.00048139     	|  20000          	|  9.6278         	|  0.35559        	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_epoch_end                 	|  0.29594        	|  20             	|  5.9188         	|  0.21861        	|
|  [Strategy]SingleDeviceStrategy.batch_to_device                                                                                                                                                             	|  0.00013363     	|  20070          	|  2.6819         	|  0.099056       	|
|  [LightningModule]NeRFSystem.transfer_batch_to_device                                                                                                                                                       	|  8.578e-05      	|  20070          	|  1.7216         	|  0.063586       	|
|  [LightningModule]NeRFSystem.optimizer_zero_grad                                                                                                                                                            	|  2.6718e-05     	|  20000          	|  0.53436        	|  0.019736       	|
|  [EvaluationEpochLoop].val_dataloader_idx_0_next                                                                                                                                                            	|  0.0055815      	|  70             	|  0.3907         	|  0.01443        	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_batch_end                 	|  1.703e-05      	|  20000          	|  0.3406         	|  0.01258        	|
|  [LightningModule]NeRFSystem.configure_gradient_clipping                                                                                                                                                    	|  1.6024e-05     	|  20000          	|  0.32047        	|  0.011836       	|
|  [Callback]GradientAccumulationScheduler.on_train_batch_end                                                                                                                                                 	|  5.2377e-06     	|  20000          	|  0.10475        	|  0.003869       	|
|  [LightningModule]NeRFSystem.on_validation_start                                                                                                                                                            	|  0.050088       	|  2              	|  0.10018        	|  0.0036999      	|
|  [Callback]TQDMProgressBar.on_after_backward                                                                                                                                                                	|  3.5939e-06     	|  20000          	|  0.071878       	|  0.0026548      	|
|  [Callback]TQDMProgressBar.on_before_zero_grad                                                                                                                                                              	|  3.1808e-06     	|  20000          	|  0.063616       	|  0.0023496      	|
|  [Callback]TQDMProgressBar.on_batch_start                                                                                                                                                                   	|  3.1801e-06     	|  20000          	|  0.063602       	|  0.0023491      	|
|  [Callback]TQDMProgressBar.on_before_optimizer_step                                                                                                                                                         	|  3.1402e-06     	|  20000          	|  0.062804       	|  0.0023196      	|
|  [Callback]TQDMProgressBar.on_before_backward                                                                                                                                                               	|  2.9795e-06     	|  20000          	|  0.05959        	|  0.0022009      	|
|  [Callback]TQDMProgressBar.on_train_batch_start                                                                                                                                                             	|  2.738e-06      	|  20000          	|  0.054759       	|  0.0020225      	|
|  [Callback]GradientAccumulationScheduler.on_batch_start                                                                                                                                                     	|  2.5697e-06     	|  20000          	|  0.051395       	|  0.0018982      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_batch_start                     	|  2.4923e-06     	|  20000          	|  0.049846       	|  0.001841       	|
|  [Callback]TQDMProgressBar.on_batch_end                                                                                                                                                                     	|  2.4605e-06     	|  20000          	|  0.04921        	|  0.0018175      	|
|  [Callback]GradientAccumulationScheduler.on_train_batch_start                                                                                                                                               	|  2.3684e-06     	|  20000          	|  0.047369       	|  0.0017495      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_batch_start               	|  2.3294e-06     	|  20000          	|  0.046588       	|  0.0017207      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_after_backward                  	|  2.1962e-06     	|  20000          	|  0.043924       	|  0.0016223      	|
|  [Callback]GradientAccumulationScheduler.on_after_backward                                                                                                                                                  	|  2.1831e-06     	|  20000          	|  0.043663       	|  0.0016127      	|
|  [Callback]GradientAccumulationScheduler.on_before_optimizer_step                                                                                                                                           	|  2.1406e-06     	|  20000          	|  0.042812       	|  0.0015812      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_batch_end                       	|  2.1107e-06     	|  20000          	|  0.042215       	|  0.0015592      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_before_optimizer_step           	|  2.0512e-06     	|  20000          	|  0.041024       	|  0.0015152      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_before_zero_grad                	|  2.0326e-06     	|  20000          	|  0.040651       	|  0.0015014      	|
|  [Callback]GradientAccumulationScheduler.on_before_zero_grad                                                                                                                                                	|  2.0312e-06     	|  20000          	|  0.040625       	|  0.0015005      	|
|  [Callback]GradientAccumulationScheduler.on_before_backward                                                                                                                                                 	|  1.9764e-06     	|  20000          	|  0.039527       	|  0.0014599      	|
|  [Callback]GradientAccumulationScheduler.on_batch_end                                                                                                                                                       	|  1.9661e-06     	|  20000          	|  0.039322       	|  0.0014523      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_before_backward                 	|  1.959e-06      	|  20000          	|  0.039179       	|  0.0014471      	|
|  [LightningModule]NeRFSystem.on_before_batch_transfer                                                                                                                                                       	|  1.7157e-06     	|  20070          	|  0.034435       	|  0.0012718      	|
|  [Callback]TQDMProgressBar.on_validation_batch_end                                                                                                                                                          	|  0.00045813     	|  70             	|  0.032069       	|  0.0011845      	|
|  [LightningModule]NeRFSystem.training_step_end                                                                                                                                                              	|  1.4872e-06     	|  20000          	|  0.029744       	|  0.0010986      	|
|  [LightningModule]NeRFSystem.on_train_batch_end                                                                                                                                                             	|  1.2251e-06     	|  20000          	|  0.024501       	|  0.00090494     	|
|  [LightningModule]NeRFSystem.on_after_batch_transfer                                                                                                                                                        	|  1.1395e-06     	|  20070          	|  0.022869       	|  0.00084466     	|
|  [Strategy]SingleDeviceStrategy.training_step_end                                                                                                                                                           	|  1.1303e-06     	|  20000          	|  0.022606       	|  0.00083492     	|
|  [LightningModule]NeRFSystem.on_before_optimizer_step                                                                                                                                                       	|  1.0222e-06     	|  20000          	|  0.020443       	|  0.00075505     	|
|  [LightningModule]NeRFSystem.on_train_batch_start                                                                                                                                                           	|  9.8989e-07     	|  20000          	|  0.019798       	|  0.00073122     	|
|  [LightningModule]NeRFSystem.on_after_backward                                                                                                                                                              	|  9.8006e-07     	|  20000          	|  0.019601       	|  0.00072396     	|
|  [LightningModule]NeRFSystem.on_before_zero_grad                                                                                                                                                            	|  9.3554e-07     	|  20000          	|  0.018711       	|  0.00069107     	|
|  [Strategy]SingleDeviceStrategy.on_train_batch_start                                                                                                                                                        	|  9.058e-07      	|  20000          	|  0.018116       	|  0.0006691      	|
|  [LightningModule]NeRFSystem.on_before_backward                                                                                                                                                             	|  8.9739e-07     	|  20000          	|  0.017948       	|  0.00066289     	|
|  [LightningModule]NeRFSystem.validation_epoch_end                                                                                                                                                           	|  0.0042436      	|  2              	|  0.0084872      	|  0.00031347     	|
|  [Callback]TQDMProgressBar.on_train_epoch_start                                                                                                                                                             	|  0.00025537     	|  20             	|  0.0051073      	|  0.00018864     	|
|  [Callback]TQDMProgressBar.on_train_epoch_end                                                                                                                                                               	|  0.00024416     	|  20             	|  0.0048831      	|  0.00018036     	|
|  [LightningModule]NeRFSystem.configure_optimizers                                                                                                                                                           	|  0.0036624      	|  1              	|  0.0036624      	|  0.00013527     	|
|  [Callback]TQDMProgressBar.on_validation_batch_start                                                                                                                                                        	|  4.0531e-05     	|  70             	|  0.0028372      	|  0.00010479     	|
|  [LightningModule]NeRFSystem.lr_scheduler_step                                                                                                                                                              	|  0.00010203     	|  20             	|  0.0020406      	|  7.537e-05      	|
|  [Callback]TQDMProgressBar.on_validation_end                                                                                                                                                                	|  0.00061184     	|  2              	|  0.0012237      	|  4.5196e-05     	|
|  [LightningModule]NeRFSystem.on_validation_model_train                                                                                                                                                      	|  0.00048774     	|  2              	|  0.00097548     	|  3.6029e-05     	|
|  [LightningModule]NeRFSystem.on_validation_model_eval                                                                                                                                                       	|  0.00045674     	|  2              	|  0.00091348     	|  3.3739e-05     	|
|  [LightningModule]NeRFSystem.train_dataloader                                                                                                                                                               	|  0.00080089     	|  1              	|  0.00080089     	|  2.958e-05      	|
|  [Callback]TQDMProgressBar.on_validation_start                                                                                                                                                              	|  0.00028261     	|  2              	|  0.00056521     	|  2.0876e-05     	|
|  [Callback]GradientAccumulationScheduler.on_validation_batch_end                                                                                                                                            	|  7.2084e-06     	|  70             	|  0.00050459     	|  1.8637e-05     	|
|  [Callback]TQDMProgressBar.on_train_start                                                                                                                                                                   	|  0.00037602     	|  1              	|  0.00037602     	|  1.3888e-05     	|
|  [LightningModule]NeRFSystem.val_dataloader                                                                                                                                                                 	|  0.00031468     	|  1              	|  0.00031468     	|  1.1622e-05     	|
|  [Callback]TQDMProgressBar.on_train_end                                                                                                                                                                     	|  0.00026678     	|  1              	|  0.00026678     	|  9.8532e-06     	|
|  [Callback]GradientAccumulationScheduler.on_validation_batch_start                                                                                                                                          	|  3.5976e-06     	|  70             	|  0.00025183     	|  9.3013e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_batch_end            	|  2.9217e-06     	|  70             	|  0.00020452     	|  7.5537e-06     	|
|  [LightningModule]NeRFSystem.validation_step_end                                                                                                                                                            	|  2.9122e-06     	|  70             	|  0.00020385     	|  7.5292e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_batch_start          	|  2.6562e-06     	|  70             	|  0.00018593     	|  6.8673e-06     	|
|  [LightningModule]NeRFSystem.on_validation_batch_end                                                                                                                                                        	|  2.3224e-06     	|  70             	|  0.00016257     	|  6.0043e-06     	|
|  [LightningModule]NeRFSystem.on_validation_batch_start                                                                                                                                                      	|  1.7323e-06     	|  70             	|  0.00012126     	|  4.4787e-06     	|
|  [Callback]GradientAccumulationScheduler.on_train_epoch_start                                                                                                                                               	|  6.0225e-06     	|  20             	|  0.00012045     	|  4.4487e-06     	|
|  [Callback]GradientAccumulationScheduler.on_validation_end                                                                                                                                                  	|  5.6389e-05     	|  2              	|  0.00011278     	|  4.1654e-06     	|
|  [Callback]GradientAccumulationScheduler.on_train_epoch_end                                                                                                                                                 	|  5.2264e-06     	|  20             	|  0.00010453     	|  3.8607e-06     	|
|  [Strategy]SingleDeviceStrategy.validation_step_end                                                                                                                                                         	|  1.2714e-06     	|  70             	|  8.9e-05        	|  3.2872e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_end                  	|  4.4109e-05     	|  2              	|  8.8219e-05     	|  3.2583e-06     	|
|  [Callback]TQDMProgressBar.on_epoch_start                                                                                                                                                                   	|  3.6044e-06     	|  22             	|  7.9297e-05     	|  2.9288e-06     	|
|  [Callback]TQDMProgressBar.on_epoch_end                                                                                                                                                                     	|  2.8549e-06     	|  22             	|  6.2807e-05     	|  2.3198e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_epoch_start               	|  2.9614e-06     	|  20             	|  5.9228e-05     	|  2.1876e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.setup                              	|  5.1118e-05     	|  1              	|  5.1118e-05     	|  1.888e-06      	|
|  [Callback]GradientAccumulationScheduler.on_epoch_start                                                                                                                                                     	|  2.1882e-06     	|  22             	|  4.814e-05      	|  1.778e-06      	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_epoch_start                     	|  2.1032e-06     	|  22             	|  4.627e-05      	|  1.7089e-06     	|
|  [Callback]GradientAccumulationScheduler.on_epoch_end                                                                                                                                                       	|  2.0948e-06     	|  22             	|  4.6086e-05     	|  1.7022e-06     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_epoch_end                       	|  2.0658e-06     	|  22             	|  4.5449e-05     	|  1.6786e-06     	|
|  [LightningModule]NeRFSystem.on_train_epoch_end                                                                                                                                                             	|  1.512e-06      	|  20             	|  3.0239e-05     	|  1.1169e-06     	|
|  [LightningModule]NeRFSystem.on_epoch_start                                                                                                                                                                 	|  1.3668e-06     	|  22             	|  3.007e-05      	|  1.1106e-06     	|
|  [LightningModule]NeRFSystem.on_epoch_end                                                                                                                                                                   	|  1.2937e-06     	|  22             	|  2.8461e-05     	|  1.0512e-06     	|
|  [LightningModule]NeRFSystem.on_train_epoch_start                                                                                                                                                           	|  1.4015e-06     	|  20             	|  2.803e-05      	|  1.0353e-06     	|
|  [LightningModule]NeRFSystem.on_train_end                                                                                                                                                                   	|  1.76e-05       	|  1              	|  1.76e-05       	|  6.5005e-07     	|
|  [LightningModule]NeRFSystem.configure_callbacks                                                                                                                                                            	|  1.053e-05      	|  1              	|  1.053e-05      	|  3.889e-07      	|
|  [LightningModule]NeRFSystem.on_validation_epoch_end                                                                                                                                                        	|  4.9397e-06     	|  2              	|  9.8795e-06     	|  3.6489e-07     	|
|  [Callback]TQDMProgressBar.on_validation_epoch_end                                                                                                                                                          	|  4.7102e-06     	|  2              	|  9.4203e-06     	|  3.4793e-07     	|
|  [Callback]GradientAccumulationScheduler.on_validation_start                                                                                                                                                	|  4.4601e-06     	|  2              	|  8.9202e-06     	|  3.2946e-07     	|
|  [Callback]GradientAccumulationScheduler.on_fit_start                                                                                                                                                       	|  8.7498e-06     	|  1              	|  8.7498e-06     	|  3.2317e-07     	|
|  [Strategy]SingleDeviceStrategy.on_validation_end                                                                                                                                                           	|  4.34e-06       	|  2              	|  8.6799e-06     	|  3.2059e-07     	|
|  [Callback]TQDMProgressBar.setup                                                                                                                                                                            	|  7.6294e-06     	|  1              	|  7.6294e-06     	|  2.8179e-07     	|
|  [Callback]TQDMProgressBar.on_pretrain_routine_start                                                                                                                                                        	|  6.4801e-06     	|  1              	|  6.4801e-06     	|  2.3934e-07     	|
|  [Callback]GradientAccumulationScheduler.on_validation_epoch_end                                                                                                                                            	|  2.7646e-06     	|  2              	|  5.5293e-06     	|  2.0422e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_epoch_end            	|  2.6599e-06     	|  2              	|  5.3197e-06     	|  1.9648e-07     	|
|  [Callback]TQDMProgressBar.on_fit_end                                                                                                                                                                       	|  5.3197e-06     	|  1              	|  5.3197e-06     	|  1.9648e-07     	|
|  [Callback]TQDMProgressBar.on_fit_start                                                                                                                                                                     	|  5.2899e-06     	|  1              	|  5.2899e-06     	|  1.9538e-07     	|
|  [Callback]TQDMProgressBar.on_validation_epoch_start                                                                                                                                                        	|  2.5001e-06     	|  2              	|  5.0003e-06     	|  1.8468e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_start                     	|  4.9397e-06     	|  1              	|  4.9397e-06     	|  1.8245e-07     	|
|  [LightningModule]NeRFSystem.on_pretrain_routine_start                                                                                                                                                      	|  4.8e-06        	|  1              	|  4.8e-06        	|  1.7729e-07     	|
|  [Callback]GradientAccumulationScheduler.on_train_start                                                                                                                                                     	|  4.7507e-06     	|  1              	|  4.7507e-06     	|  1.7546e-07     	|
|  [Callback]GradientAccumulationScheduler.on_train_end                                                                                                                                                       	|  4.2506e-06     	|  1              	|  4.2506e-06     	|  1.5699e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_start                	|  2.0899e-06     	|  2              	|  4.1798e-06     	|  1.5438e-07     	|
|  [Callback]TQDMProgressBar.on_configure_sharded_model                                                                                                                                                       	|  3.729e-06      	|  1              	|  3.729e-06      	|  1.3773e-07     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_validation_epoch_start          	|  1.8147e-06     	|  2              	|  3.6294e-06     	|  1.3405e-07     	|
|  [Callback]GradientAccumulationScheduler.on_validation_epoch_start                                                                                                                                          	|  1.8049e-06     	|  2              	|  3.6098e-06     	|  1.3333e-07     	|
|  [LightningModule]NeRFSystem.configure_sharded_model                                                                                                                                                        	|  3.4999e-06     	|  1              	|  3.4999e-06     	|  1.2927e-07     	|
|  [LightningModule]NeRFSystem.on_fit_start                                                                                                                                                                   	|  3.4394e-06     	|  1              	|  3.4394e-06     	|  1.2703e-07     	|
|  [LightningModule]NeRFSystem.on_validation_end                                                                                                                                                              	|  1.6256e-06     	|  2              	|  3.2512e-06     	|  1.2008e-07     	|
|  [Strategy]SingleDeviceStrategy.on_validation_start                                                                                                                                                         	|  1.58e-06       	|  2              	|  3.16e-06       	|  1.1671e-07     	|
|  [Callback]TQDMProgressBar.on_pretrain_routine_end                                                                                                                                                          	|  3.1497e-06     	|  1              	|  3.1497e-06     	|  1.1633e-07     	|
|  [Callback]GradientAccumulationScheduler.setup                                                                                                                                                              	|  3.0901e-06     	|  1              	|  3.0901e-06     	|  1.1413e-07     	|
|  [Callback]TQDMProgressBar.on_before_accelerator_backend_setup                                                                                                                                              	|  2.9299e-06     	|  1              	|  2.9299e-06     	|  1.0822e-07     	|
|  [Callback]TQDMProgressBar.teardown                                                                                                                                                                         	|  2.7502e-06     	|  1              	|  2.7502e-06     	|  1.0158e-07     	|
|  [LightningModule]NeRFSystem.prepare_data                                                                                                                                                                   	|  2.4103e-06     	|  1              	|  2.4103e-06     	|  8.9021e-08     	|
|  [Callback]GradientAccumulationScheduler.on_before_accelerator_backend_setup                                                                                                                                	|  2.3404e-06     	|  1              	|  2.3404e-06     	|  8.6442e-08     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_before_accelerator_backend_setup	|  2.2501e-06     	|  1              	|  2.2501e-06     	|  8.3105e-08     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_configure_sharded_model         	|  2.1597e-06     	|  1              	|  2.1597e-06     	|  7.9768e-08     	|
|  [Callback]GradientAccumulationScheduler.on_fit_end                                                                                                                                                         	|  2.1588e-06     	|  1              	|  2.1588e-06     	|  7.9734e-08     	|
|  [Callback]GradientAccumulationScheduler.on_pretrain_routine_start                                                                                                                                          	|  2.1504e-06     	|  1              	|  2.1504e-06     	|  7.9424e-08     	|
|  [Callback]GradientAccumulationScheduler.on_configure_sharded_model                                                                                                                                         	|  2.1299e-06     	|  1              	|  2.1299e-06     	|  7.8668e-08     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_fit_start                       	|  2.1299e-06     	|  1              	|  2.1299e-06     	|  7.8668e-08     	|
|  [LightningModule]NeRFSystem.on_validation_epoch_start                                                                                                                                                      	|  1.0547e-06     	|  2              	|  2.1094e-06     	|  7.7911e-08     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_pretrain_routine_start          	|  2.0899e-06     	|  1              	|  2.0899e-06     	|  7.7189e-08     	|
|  [Callback]GradientAccumulationScheduler.teardown                                                                                                                                                           	|  2.0498e-06     	|  1              	|  2.0498e-06     	|  7.5709e-08     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_train_end                       	|  2.0405e-06     	|  1              	|  2.0405e-06     	|  7.5365e-08     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_fit_end                         	|  1.9893e-06     	|  1              	|  1.9893e-06     	|  7.3474e-08     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.teardown                           	|  1.9502e-06     	|  1              	|  1.9502e-06     	|  7.2029e-08     	|
|  [Callback]GradientAccumulationScheduler.on_pretrain_routine_end                                                                                                                                            	|  1.8999e-06     	|  1              	|  1.8999e-06     	|  7.0171e-08     	|
|  [Callback]ModelCheckpoint{'monitor': None, 'mode': 'min', 'every_n_train_steps': 0, 'every_n_epochs': 20, 'train_time_interval': None, 'save_on_train_epoch_end': True}.on_pretrain_routine_end            	|  1.8701e-06     	|  1              	|  1.8701e-06     	|  6.9071e-08     	|
|  [LightningModule]NeRFSystem.on_save_checkpoint                                                                                                                                                             	|  1.7704e-06     	|  1              	|  1.7704e-06     	|  6.539e-08      	|
|  [LightningModule]NeRFSystem.on_pretrain_routine_end                                                                                                                                                        	|  1.6801e-06     	|  1              	|  1.6801e-06     	|  6.2054e-08     	|
|  [LightningModule]NeRFSystem.on_fit_end                                                                                                                                                                     	|  1.4501e-06     	|  1              	|  1.4501e-06     	|  5.3557e-08     	|
|  [LightningModule]NeRFSystem.on_train_start                                                                                                                                                                 	|  1.3895e-06     	|  1              	|  1.3895e-06     	|  5.1321e-08     	|
|  [Strategy]SingleDeviceStrategy.on_train_start                                                                                                                                                              	|  1.3001e-06     	|  1              	|  1.3001e-06     	|  4.8019e-08     	|
|  [LightningModule]NeRFSystem.teardown                                                                                                                                                                       	|  1.2703e-06     	|  1              	|  1.2703e-06     	|  4.6919e-08     	|
|  [Strategy]SingleDeviceStrategy.on_train_end                                                                                                                                                                	|  9.7975e-07     	|  1              	|  9.7975e-07     	|  3.6186e-08     	|
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
