R studio not installing spark (sparklyr)
**I am trying to use apache spark with R, using the sparklyr package.
When I use the spark_install() function, it starts downloading a file from internet. But the download never finishes and results in an error.**
I’ve loade the sparklyr package in R and used this function
spark_install()
This was the response, the downloaded started:
Installing Spark 3.5.1 for Hadoop 3 or later.
Downloading from:
- ‘https://dlcdn.apache.org/spark/spark-3.5.1/spark-3.5.1-bin-hadoop3.tgz’
Installing to: - ‘~/spark/spark-3.5.1-bin-hadoop3’
trying URL ‘https://dlcdn.apache.org/spark/spark-3.5.1/spark-3.5.1-bin-hadoop3.tgz’
But after 2 or 3 minutes this error pops up.
Error in download.file(…) :
cannot open URL ‘https://dlcdn.apache.org/spark/spark-3.5.1/spark-3.5.1-bin-hadoop3.tgz’
I’ve tried with different versions and the resulting error is pratically the same:
Installing Spark 3.5.0 for Hadoop 3 or later.
Downloading from:
- ‘https://archive.apache.org/dist/spark/spark-3.5.0/spark-3.5.0-bin-hadoop3.tgz’
Installing to: - ‘~/spark/spark-3.5.0-bin-hadoop3’
trying URL ‘https://archive.apache.org/dist/spark/spark-3.5.0/spark-3.5.0-bin-hadoop3.tgz’
Content type ‘application/x-gzip’ length 400395283 bytes (381.8 MB)
====
downloaded 32.0 MB
Error in download.file(…) :
download from ‘https://archive.apache.org/dist/spark/spark-3.5.0/spark-3.5.0-bin-hadoop3.tgz’ failed
Read more here: Source link
