This is a public Topic to discuss everything related to Quantexa training - content posted here will be visible to all. To raise a question please visit the Academy Q&A Topic

FAQ: I'm trying to run a script and seeing an error about "Unrecognized option: -s"

Dan_Pryer
Dan_Pryer Posts: 1,647 QUANTEXA TEAM
edited October 2023 in Academy

FAQ relevant for: all Academy versions

If you are trying to run a Scala script (e.g. ImportRawToParqet) and you see the above mentioned error, the main cause of this is that the program can't find the relevant JAR file to run. You may also get an error saying something like "<jar name>.jar not found" or "jar <jar name> does not exist, skipping."

The solution to this error is to build the relevant JAR file(s) as specified in the Spark Shell script that you tried to run the Scala file with. For example, in the "runQSS.sh" script of the academy task project, you will see that this requires two JARs: the data-source-all Project and Dependency shadow JARs. By building these two JARs and verifying that they are in the correct location and have the correct name to match the full file paths in the relevant Spark Shell script, this should fix the issue.

Let us know in a new post if the above solution didn't fix the issue for you!

Dan Pryer - Senior Data Engineer (R&D)

Did my reply answer your question? Then why not mark it as having answered in the bottom right corner of my post! 😁

Tagged:
Chris_HarrisNorah_AlsudaniTameem_SamawiacrayAndrewBirchAngelo_Perrone
User Profiles
Academy Topic Owners
Feel free to ask our Topic Owners a question on all things related to our Academy
Academy Team Lead
Academy Team Lead
Academy Team Lead
Quantexa Vision &
Product Ideation
webinar
Listen Now
HTML tutorial