Im using Pentaho for my ETL tool project. Can I have a detailed step by step on how to for the ff.
I want to have a repository for all the sql scripts we are running everyday.
I want to learn how to schedule this routine.
Daily we ran different queries in postgres database and we want it to automate. Can you help me this. I would appreciate your immediate response. Thank you.
tin,
I suggest taking a step back and reading the manual at this point. If you're serious about this, later on you'll be happy you have read it. Once you feel comfortable with the tool, you might want to read this excellent book as well. Do that and all your questions will be answered, promised. You can also drop by the unofficial IRC channel. There are always fine folks from the community and some core developers available to help you. It's channel ##pentaho on irc.freenode.net.
There are no quick way to properly use these tools. They are powerful and will help you do a lot, but they are complex and you will have to figure out how to use them to your advantage and that requires experience. Trust me, I work at Pentaho. =)
Related
We are supposed to make a web-based project using postgres. The topic is library management system, where on a website a user can search whether a book is available in the library, if it is present then where, and so on.
The problem is just that I don't know anything about web development. I do have a pretty good knowledge of sql, but I'm confused a bit in that too, because I don't know if I'll just have to run the queries in my laptop in postgres and link if it "somehow" to the website, or will I have to upload my data on some server (for eg., firebase in case Android development) to be used in my website.
So briefly, I've just two questions:-
How should I start, because I have no idea where to begin with(I do have all the data needed btw)?
About postgres, will the queries run on my laptop or some server?
Please help me with this. Some online resources for the same are way more than just welcome, because I was unable to find any. Thank you!
First of all, you'd take a look at some design pattern in order to learn some theory on how to make (web) apps in the right way. You can visit Martin Fowler's web site and read them.
Once studied, you'd follow my advice. If you've got Java expetise, I'd start by learning Spring Boot, which has every piece you need to achieve your goal. This project follows lot's of design patterns (MVC, Repository, DAO, AOP, IoC/DI...) and lets you follow others (DTO). Anyway, choose the right template engine (I like Thymeleaf) or any other framework (Angular 2...).
Hope it helps.
welcome to development world. When starting out it seems very confusing but it is not that much.
Start slow, there are many tutorials across which helps.. just do a bit of google.
To answer your question :
How should I start, because I have no idea where to begin with(I do have all the data needed btw)?
-- Google simple website with postgres db. For that you will require the database to be installed and a webserver on your machine. All of which will be used when you host the website
About postgres, will the queries run on my laptop or some server?
-- It will run on where you have installed the database..
hope this helps :)
as of right now i'm working at place where's there's a lot of legacy codes and pretty much no useful documentation.
and most of the time we just treat business requirements as whatever that is already implemented previously.
i'm looking for any tools or useful method to keep all the requirements for future use and for regression testing mostly.
i'm thinking of maybe linking them up to tests/unit test too so that the business requirements are linked directly to the coding logic.
Any good tools or resources to get me started?
thanks~
Updates
As of now i'm making things simple on myself by writing use case and then create some simple use case diagram using this awesome tool and then convert each use case into a test plan. The test plan is meant for the end user, thus i just make it into a simple step by step flow. I had plans to automate this part using selenium but it wasn't working that well on our website and was taking too long. It's a bit TDD, but i think it create simple understandable goal for both end user and the developer, i hope.
So for now it's just excel and doc file, lugged into the project doc folder and check into cvs/svn doomed to be outdated and be forgotten :P
Business requirements can be well capture in FitNess tests. As for Unit Test they sur help, and but both together in continuous integration like Hudson to detect regression ASAP.
PS: Sorry pretty much all links go to some articles I wrote because I'm also interested in that subject.
Here are some methods/systems that I have used
HP Quality Center
Big and bulky. Not very agile but it works and has a lot of feautres.
It's used in many larger corporations and if you can afford you can get great support from HP
https://h10078.www1.hp.com/cda/hpms/display/main/hpms_content.jsp?zn=bto&cp=1-11-127-24%5E1131_4000_100__
Bugzilla-Testopia
Open Source test case management extension for Bugzilla, managed by Mozilla. Which is good enough in my book to give it a try.
http://www.mozilla.org/projects/testopia/
Excel/Open Office Calc
Just do everything in spreadsheets and link between them.
Very flexible, everybody knows how to use them and you propbably have the software in your organization already.
Other Open Source Solutions
List of 15+ Open Source Test Management Tools
http://www.jayphilips.com/2009/09/10/15-open-source-test-management-tools/
I am relatively new to using SQL Server (we're on 2005) but not to database design, creation, and programming. I have decided to use TSQLUnit for the testing we want to do, and have been learning it as I go. But, there are some things that have not become clear over time, and it gets pretty frustrating to want to do a particular type of test and not be able to do it. I'm not sure if the problem is with SQL Server (very unlikely), TSQLUnit (unlikely) or me (very likely).
Does anyone know of an online resource or community of TSQLUnit users that I could consult? I would like to both contribute when I can and gain benefit when needed.
Any suggestions or links will be appreciated.
There are so many
SQLBangalore on Facebook.
Even you can post questions in SQlcetral as well.
Can anyone recommend a graphical tool to make browsing Oracle SQL Trace files easier?
TKProf is great for summary info, but lately I am needing more detail on a specific run of a statement and end up going back to the trace file directly. Summarization and filtering would be pluses, but mainly looking for something with some basic drill down into detail for each statement.
I stumbled upon the trace file browser in SQL Developer 1.5.5. It would be perfect if it didn't take minutes to load up multi-megabyte files.
I have Toad 9.x but I can't seem to invoke the utilities for viewing trace files, possible I don't have that option licensed. Like so many features I find hints about it in the online help but can't seem to find the menu selections they mention in the help file or a clear connection to what needs to be licensed to enable the feature.
Do you have any suggestions for any other tools I should investigate?
Allround Automations' PL/SQL Developer has a GUI for viewing traces. I've only used it for small traces myself but it seems pretty quick.
There is a trial version available for download from their website, I would recommended trying it out and seeing how it works for you. My company has bought us licenses and frankly, if you are developing PL/SQL, this is the best tool available. TOAD might be better for the DBA, but for programming, this is your best friend.
Do you think Microsoft's RAP program worth the money you pay ?
Any suggestions ?
Thanks
I would have to say that it depends on a number of factors. First how knowledgeable are you at configuring and maintaining the specific versions of SQL Server that they would be looking at? Then why are you doing the SQL RAP? Is it to really get a good risk assessment, to demonstrate to management that things are being done correctly, or to learn where you are coming up short in an effort to correct things and find areas to learn more about the product, or is it none of the above?
I had a SQL RAP done at the end of last year, and I can tell you from personal experience, you will only get as much from it as you are open to learning. If you have a cluster, be prepared to have your eyes opened to areas you never thought to look at. The SQL RAP visit has four different phases, or at least mine did. First they collect the data from your SQL Servers using pssdiag and a bunch of other neat tools that they leave copies of most with you. Then they go into analysis, where they take the data and perform a very thorough analysis of it and generate reports and recommendations. Then they sit down with you and management if you so chose and go over everything, what was good, what was iffy, and what was bad. Then the last part they sit down with you as a DBA and teach you how to use the tools they used and that they can leave copies of with you. They go over the PAL Tool, SQL Nexus, and some others and make sure that you know how to use these tools to do self analysis. Best of all, they leave you these really detailed reports that you can use as a self check for setting up new environments in the future.
Is it worth it? You probably can't tell that until you are done with it. For me, I'd recommend it to anyone who wants to know more about running a "Best Practice" implementation of SQL Server, and who'd like some one on one learning time with a Senior Microsoft Field Engineer.
Oh boy, is that all they does with this much hyped RAP.
Pssdiag is already done.
We did the PAL and Nexus and they too did it before.
They took around 20 Gigs of size trace files to analyse.
Now, wanted to do RAP. Holy cRAP, if this is the same thing to do again, what that's for.
I expect much more than this level of analysis without which I think this is useless and waste of money.
I've been a part of 2 RAPs for SharePoint (finished my second 2 weeks ago). I am unsure as to how much it costs (the company I work for gets 3 RAPs a year with MS) but it is most definitely worth it.
Starting 2010, the PFE will leave the RAP tool installed on the data collection machine. This means that for up to a year, you can rerun the full RAP as many times as you want and analyze the results.
The RAP tool (for SharePoint) runs a bunch of tests that are categorized as below:
SQL Configuration (24)
Server Health (4)
Server Configuration (7)
MOSS Configuration (2)
Each test produces a list of issues with detailed recommendations on how to resolve them.
Additionally, a competent PFE (and they are) will help troubleshoot any outstanding issues you have in your environment and give you the opportunity to listen and learn.
I would recommend the MS RAP to all SharePoint (and SQL) Admins.
If you have never had one, then I think you will have benefit from going through it at least one time. I warn you that it can be quite humbling.