update SPARK_WORKER_MEMORY to 1g to fix resource issues on both Win11 and Linux

[adrianyorke]

Introduction

Hi there, thanks for helping the project! We are doing our best to help the community to learn and practice
parallel computing in distributed environments through our projects. ✨

Pull Request

Issue

• Increase SPARK_WORKER_MEMORY to 1g #92

Changes

• Increase memory from 512m to 1g - this fix works on both Windows 11 and Linux

Comments (optional)

• I can test on Mac OS during December 2024 - just waiting for my new workstation

Checklist

Please make sure to check the following:

• I have followed the steps in the CONTRIBUTING.md file.
• I am aware that pull requests that do not follow the rules will be automatically rejected.

[adrianyorke]

fixes #92